Photoshop powered by Firefly's generative AI

Kerem Gülen
May 23, 2023

Photoshop is receiving a significant enhancement in the form of generative AI integration. The latest update introduces a range of Firefly-based features, empowering users to expand the boundaries of their images by incorporating Firefly-generated backgrounds. Additionally, the new capabilities enable the integration of generative AI to seamlessly add objects to images and provide an enhanced generative fill feature for more precise removal of objects compared to the previously available content-aware fill tool.

At present, these advanced features are exclusively accessible in the beta version of Photoshop. However, Adobe is extending some of these capabilities to Firefly beta users on the web as well. Notably, the Firefly service has witnessed remarkable engagement, with users having created over 100 million images using the platform.

What's particularly intriguing about this integration is that Photoshop users now have the ability to utilize natural language text prompts to describe the desired image or object they want Firefly to generate. However, as is characteristic of generative AI tools, the outcomes may sometimes exhibit a certain degree of unpredictability. By default, Adobe offers users three variations for each prompt. However, unlike the Firefly web app, there is presently no option to explore similar variations of a specific result through iteration.

To accomplish this, Photoshop selectively sends portions of a given image to Firefly for processing, rather than the entire image, although the company is also actively exploring the potential of employing the entire image. Subsequently, a new layer is created within Photoshop to accommodate the generated results.

As per TechCrunch’s report, Maria Yap, the Vice President of Digital Imaging at Adobe, provided me with an exclusive demonstration of these new features ahead of today's official announcement. As is customary with generative AI technology, predicting the precise output of the model can be challenging, but some of the results were surprisingly impressive.

For example, when tasked with generating a puddle beneath a running corgi, Firefly demonstrated an understanding of the overall lighting conditions in the image, even producing a realistic reflection. While not every outcome was flawless—a vivid purple puddle was also presented—the model generally excels in adding objects to images and particularly excels in extending existing images beyond their original frame.

Considering that Firefly was trained on the extensive collection of photos available in Adobe Stock, along with other commercially safe images, it is perhaps unsurprising that it performs exceptionally well with landscapes. However, similar to many other generative image generators, Firefly encounters difficulties when dealing with text.

Image courtesy of Adobe

Adobe has taken significant measures to ensure that the generated results from the model are safe and adhere to appropriate guidelines. This assurance is partly achieved through the selection of a carefully curated training set.

“We married that with a series of prompt engineering things that we know. We exclude certain terms, certain words that we feel aren’t safe. And then we’re even looking into another hierarchy of ‘if Maria selects an area that has a lot of skin in it, maybe right now — and you’ll actually see warning messages at times — we won’t expand a prompt on that one, just because it’s unpredictable. We just don’t want to go into a place that doesn’t feel comfortable for us,” stated Yap.

Adobe is focusing on Firefly nowadays

Last month, Adobe took a significant step towards making specialized video editing skills accessible to a wider audience with the introduction of Firefly. This innovative tool harnesses the power of artificial intelligence to revolutionize the creative process, particularly in areas like color grading and storyboard creation.

By incorporating AI-powered features, Adobe has provided users with an intuitive and streamlined approach to video editing, effectively democratizing these once highly specialized skills. Now, even users without extensive expertise can navigate the creative process with greater ease and efficiency.


Tutorials & Tips

Previous Post: «
Next Post: «


  1. bruh said on August 18, 2023 at 1:25 pm

    Uhh, this has already been possible – I am not sure how but remember my brother telling me about it. I’m not a whatsapp user so not sure of the specifics, but something about sending the image as a file and somehow bypassing the default compression settings that are applied to inbound photos.

    He has also used this to share movies to whatsapp groups, and files 1Gb+.

    Like I said, I never used whatsapp, but I know 100% this isn’t a “brand new feature”, my brother literally showed me him doing it, like… 5 months ago?

  2. 💥 said on August 18, 2023 at 3:55 pm

    Martin, what happened to those: 12 Comments ( Is there a specific justifiable reason why they were deleted?

    Hmm, it looks like the gHacks website database is faulty, and not populating threads with their relevant cosponsoring posts.

  3. 45 RPM said on August 19, 2023 at 6:29 pm

    The page on ghacks this is on represents the best of why it has become so worthless, fill of click-bait junk that it’s about to be deleted from my ‘daily reads’.

    It’s really like “Press Release as re-written by some d*ck for clicks…poorly.” And the subjects are laughable. Can’t wait for “How to search for files on Windows”.

    1. owl said on August 20, 2023 at 12:51 am

      > The page on ghacks this is on represents the best of why it has become so worthless, fill of click-bait junk…

      Sadly, I have to agree.

      Only Martin and Ashwin are worth subscribing to.
      Especially Emre Çitak and Shaun are the worst ones.

      If intended “Clickbait”, it would mark the end of Ghacks Technology News.
      Ghacks doesn’t need crappy clickbaits. Clearly separate articles from newer authors (perhaps AIs and external sales person or external advertising man) as just “Advertisements”!

      We, the subscribers of Ghacks, urge Martin to make a decision.

  4. chessandonions said on August 20, 2023 at 12:40 am

    because nevermore wants to “monetize” on every aspect of human life…

  5. Frank Rizzo said on August 20, 2023 at 11:52 pm

    “Threads” is like the Walmart of Social Media.

  6. Ashray said on August 21, 2023 at 4:06 pm

    How hard can it be to clone a twitter version of that as well? They’re slow.

  7. Paul(us) said on August 21, 2023 at 5:16 pm

    Yes, why not mention how large the HD files can be?
    Why, not mention what version of WhatsApp is needed?
    These omissions make the article feel so bare. If not complete.

    1. Paul(us) said on August 21, 2023 at 5:18 pm

      Sorry posted on the wrong page.

  8. Marc said on August 21, 2023 at 6:00 pm

    such a long article for such a simple matter. Worthless article ! waste of time

  9. plusminus_ said on August 21, 2023 at 7:54 pm

    I already do this by attaching them via the ‘Document’ option.

  10. John G. said on August 21, 2023 at 11:43 pm

    I don’t know what’s going on here at Ghacks but it’s obvious that something is broken, comments are being mixed whatever the article, I am unable to find some of my later posts neither. :S

  11. Tom Hawack said on August 23, 2023 at 2:28 pm

    Quoting the article,
    “As users gain popularity, the value of their tokens may increase, allowing investors to reap rewards.”

    Besides, beyond the thrill and privacy risks or not, the point is to know how you gain popularity, be it on social sites as everywhere in life. Is it by being authentic, by remaining faithful to ourselves or is it to have this particular skill which is to understand what a majority likes, just like politicians, those who’d deny to the maximum extent compatible with their ideological partnership, in order to grab as many of the voters they can?

    I see the very concept of this as unhealthy, propagating what is already an increasing flaw : the quest for fame. I won’t be the only one to count himself out, definitely.

    1. Tom Hawack said on August 23, 2023 at 2:34 pm

      @John G. is right : my comment was posted on [] and it appears there but as well here at []

      This has been lasting for several days. Fix it or at least provide some explanations if you don’t mind.

  12. Tom said on August 24, 2023 at 11:53 am

    > Google Chrome is following in Safari’s footsteps by introducing a new feature that allows users to move the Chrome address bar to the bottom of the screen, enhancing user accessibility and interaction.

    Firefox did this long before Safari.

  13. Mavoy said on September 16, 2023 at 2:17 pm

    Basically they’ll do anything except fair royalties.

Leave a Reply

Check the box to consent to your data being stored in line with the guidelines set out in our privacy policy

We love comments and welcome thoughtful and civilized discussion. Rudeness and personal attacks will not be tolerated. Please stay on-topic.
Please note that your comment may not appear immediately after you post it.