A mother and her 14-year-old daughter are advocating for better protections for victims after AI-generated nude images of the teen and other female classmates were circulated at a high school in New Jersey.

Meanwhile, on the other side of the country, officials are investigating an incident involving a teenage boy who allegedly used artificial intelligence to create and distribute similar images of other students – also teen girls - that attend a high school in suburban Seattle, Washington.

The disturbing cases have put a spotlight yet again on explicit AI-generated material that overwhelmingly harms women and children and is booming online at an unprecedented rate. According to an analysis by independent researcher Genevieve Oh that was shared with The Associated Press, more than 143,000 new deepfake videos were posted online this year, which surpasses every other year combined.

  • PhlubbaDubba
    link
    fedilink
    arrow-up
    20
    arrow-down
    30
    ·
    7 months ago

    Sounds like an easy fix, treat it as revenge porn and CEM and prosecute it exactly the same.

    Little Timmy’s gonna think twice about distributing stable diffusions of the cheerleaders after he sees mikey’s life get ruined for that shit

    • DogMuffins@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      39
      arrow-down
      3
      ·
      7 months ago

      I don’t think kids think about consequences in this way. Also not sure if charging a 12 year old as a paedophile is the right move.

        • DogMuffins@discuss.tchncs.de
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          1
          ·
          7 months ago

          I’m not certain but I think in my jurisdiction I think distribution of CSM is the more likely charge than revenge porn.

          For a 40 year old, spending 10 years in jail and the rest of your life on the sex offenders registry would be a deterrent of some kind. I ought not to do x because I don’t want to bear consequence y.

          For a 12 year old, even if they understand that some behaviors have very deleterious consequences, they have no way to weigh those consequences. How long is 10 years? Would this be a bit like being sent to my room? What is a registry? Making these pictures on the computer is illegal, downloading torrents is illegal, dad downloads torrents all the time.

          I’m just saying that if the objective is to avoid the harm of victims, then heavy punishments are unlikely to achieve that.

    • kent_eh@lemmy.ca
      link
      fedilink
      English
      arrow-up
      30
      arrow-down
      3
      ·
      7 months ago

      Little Timmy’s gonna think twice

      I appreciate your optimism , but I don’t share it.

      Timmy is as likely to believe he is smarter than Mikey and that he won’t get caught…

    • agent_flounder@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      2
      ·
      7 months ago

      Unfortunately, 14 year olds don’t have the level of mental development for future consequences to reliably dissuade them from current impulses. For that matter consider how many adults did crime despite knowing the consequences. This approach will only succeed in filling prison with more kids.

    • The Pantser@lemmy.world
      link
      fedilink
      arrow-up
      19
      arrow-down
      16
      ·
      7 months ago

      How about we don’t destroy a kids life for something that isn’t against the law yet. Why can’t we write the laws first then go after them. Give the kid a chance.

      • OurTragicUniverse@kbin.social
        link
        fedilink
        arrow-up
        30
        arrow-down
        15
        ·
        edit-2
        7 months ago

        How many ‘boys will be boys’ second chances do you feel girls and women owe before they can start making laws about this and punishing the guys responsible?

        • cannache@slrpnk.net
          link
          fedilink
          arrow-up
          8
          arrow-down
          4
          ·
          7 months ago

          As a bi guy, it arguably goes both ways, I feel like if a woman wants to objectify a man she is free to, if a man so much as looks at a woman he’s automatically a creep, or potential “predator” meanwhile women in Saudi will get a good looking guy like Al Gala deported. Like what the hell right?!

        • BoneALisa
          link
          fedilink
          English
          arrow-up
          8
          arrow-down
          5
          ·
          edit-2
          7 months ago

          I dont really think its a “boys will be boys” issue, and more that i dont think any child deserves to have their entire life ruined for something so early in their life. While i dont disagree that its very tramatic for the girls, and it is a really fucked up thing to do that should have no excuses for being acceptable, i feel there are better ways to tackle this issue than marking a 14 year old as a sexual predator or throwing them in jail barring them from a large portion of jobs, housing, etc. for the rest of their life.

          But to be clear, i am a prison abolitionist in general, so take that as you will.

          • Flying Squid@lemmy.world
            link
            fedilink
            arrow-up
            9
            arrow-down
            7
            ·
            7 months ago

            These girls are going to have their lives ruined because fake porn with their faces doesn’t disappear from the internet. This could follow them for the rest of their lives. Where is the justice for them?

            • BoneALisa
              link
              fedilink
              English
              arrow-up
              1
              ·
              7 months ago

              I am in no way trying to downplay the hurt and pain something like that causes. As a dude, I don’t think I can ever really be able to know what that feels like, but I can recognize it and empathize with it. No one deserves to go through and live with something like that. It totally sucks, I agree.

              However, what exactly is destroying another child’s life going to solve? Is it going to make that child stop doing the thing they were punished for? Maybe, but the US recidivism rates beg to differ (44% within the first year). So what then? Is it just to make us feel good, being happy to watch another person get hurt, justified by this made up concept of ‘justice’? That’s the more likely answer, IMO.

              There are much more constructive ways to prevent this from happening again that doesn’t require marking a child as an “undesirable” for the rest of their life. I can’t necessarily point to what that might look like, maybe enforced counseling to try and teach someone like that why what they did caused so much harm.

              Ultimately, what I am trying to say is that someone like this should be held accountable for their actions, but enforcing suffering from the state is not an effective or moral way to do it.

      • Lmaydev@programming.dev
        link
        fedilink
        arrow-up
        13
        arrow-down
        7
        ·
        7 months ago

        Yeah they need to change the law to treat it the same as a real photo being distributed essentially. As the damage is very similar.

      • calypsopub@lemmy.world
        link
        fedilink
        arrow-up
        2
        arrow-down
        6
        ·
        7 months ago

        No jail, just forbid access to any computing device until age 18. That will scare them straight.

      • PhlubbaDubba
        link
        fedilink
        arrow-up
        11
        arrow-down
        21
        ·
        7 months ago

        The kid is spreading kiddy porn and revenge porn

        Little twerp deserves it and he don’t deserve it any less just because he’s younger than all the other sex offenders who deserved it.

        • Stumblinbear@pawb.social
          link
          fedilink
          arrow-up
          9
          arrow-down
          4
          ·
          edit-2
          7 months ago

          You’re getting downvoted but juvenile detention exists for a reason. All these people out here thinking children don’t understand that laws apply to them should be wondering why kids aren’t murdering each other or committing theft daily

          • PhlubbaDubba
            link
            fedilink
            arrow-up
            4
            arrow-down
            4
            ·
            7 months ago

            They’re focusing on the kid aspect because that’s easier to fight in their eyes than the revenge porn angle, which I’m just gonna assume they’ve all gone and done