this post was submitted on 13 Apr 2024
409 points (98.8% liked)

Technology

59587 readers
2481 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

When Adobe Inc. released its Firefly image-generating software last year, the company said the artificial intelligence model was trained mainly on Adobe Stock, its database of hundreds of millions of licensed images. Firefly, Adobe said, was a “commercially safe” alternative to competitors like Midjourney, which learned by scraping pictures from across the internet.

But behind the scenes, Adobe also was relying in part on AI-generated content to train Firefly, including from those same AI rivals. In numerous presentations and public postsabout how Firefly is safer than the competition due to its training data, Adobe never made clear that its model actually used images from some of these same competitors.

you are viewing a single comment's thread
view the rest of the comments
[–] hyper 36 points 7 months ago* (last edited 7 months ago) (2 children)

I’m not so sure about that.. if you train an ai on images with disfigured anatomy which it thinks is the “right” way it will generate new images with messed up anatomy. It gives a feedback loop, like when a mic picks up its own signal.

[–] [email protected] 2 points 7 months ago

Well, you wouldn't train on images that you consider bad, or rather you'd use them as examples for what not to do.

Yes, you have to be careful when training a model on its own output. It already has a tendency to produce that, so it's easy to "overshoot", so to say. But it's not a problem in principle. It's also not what's happening here. Adobe doesn't use the same model as Midjourney.

[–] [email protected] -2 points 7 months ago* (last edited 7 months ago)

Midjourney doesn't generate disfigured anatomy. You're think of Stable Diffusion which is a smaller model that can generate an image in 30 seconds on my laptop GPU. Even SD is pretty good at avoiding that, with decent hardware and larger models (that need more memory).