Popular YouTuber @Mrwhosetheboss has singled out the Google Tensor G3 as a major failing of the Pixel 8 Pro. According to the YouTuber, all of the new generative AI features found on the Pixel 8 Pro cannot be processed onboard the device, but need to be off-loaded to the cloud for processing, despite Google pitching the device as being “AI-first.”
  • adam@kbin.pieho.me
    342·
    11 months ago

    ITT people who don’t understand that generative ML models for imagery take up TB of active memory and TFLOPs of compute to process.

    • hotdoge42@feddit.deEnglish
      142·
      11 months ago

      That’s wrong. You can do it on your home PC with stable diffusion.

      • ᗪᗩᗰᑎ@lemmy.mlEnglish
        193·
        11 months ago

        And a lot of those require models that are multiple Gigabytes in size that then need to be loaded into memory and are processed on a high end video card that would generate enough heat to ruin your phones battery if they could somehow shrink it to fit inside a phone. This just isn’t feasible on phones yet. Is it technically possible today? Yes, absolutely. Are the tradeoffs worth it? Not for the average person.

        • diomnep@lemmynsfw.comEnglish
          1·
          11 months ago

          “He’s off by multiple orders of magnitude, and he doesn’t even mention the resource that GenAI models require in large amounts (GPU), but he’s not wrong”