June 16, 2026
Developing artificial-intelligence systems to enhance digital art creation
Jessine Hein
Join Our Community of Science Lovers!
When Lvmin Zhang was in high school, he says, everyone thought artificial intelligence was science fiction. A machine couldn’t possibly hold a conversation with a person.
That was then. Today Zhang, a graduate student at Stanford University, is at the forefront of AI development, making it easier for artists to create what’s in their heads. Digital art can be painstaking—getting an image or an idea from brain to chip by using software or asking AI to build a vision, layer by layer, without its having any a priori knowledge of what the artist is trying to create.
On supporting science journalism
If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.
Christie Hemm Klok
Zhang’s AI, ControlNet, aims to fix that by giving image-creating AI systems what amounts to directions. It provides parameters allowing a user to build on an initial prompt in a way that keeps the parts of the image they want, adjusts to refining prompts and designs the product they have in their brain. Previously this process was hard—the image-creating AI wouldn’t necessarily know, even with the most precise prompts, how to add or shade or place objects in the artwork, for example. ControlNet lets the computerized image creator into the mind of the human creator.
Zhang’s work, developed not long after he started his Ph.D., is becoming popular. He recognizes that the use of AI in art is something that both creators and viewers are still grappling with on a philosophical (Is this art?), if not legal (Is copyright involved?), level, but he believes that AI can be helpful. “The real questions are what it can do, what it can’t, why it’s capable of the things it is and what it should be doing in the first place. That’s the groundwork we need before AI can really help people in ways that are efficient, honest, genuinely engaging and thought-provoking and that, at the end of the day, have some real heart to them.”
This article is part of “The Young American Scientists,” an editorially independent project that was produced with financial support from Regeneron.
It’s Time to Stand Up for Science
If you enjoyed this article, I’d like to ask for your support. Scientific American has served as an advocate for science and industry for 180 years, and right now may be the most critical moment in that two-century history.
I’ve been a Scientific American subscriber since I was 12 years old, and it helped shape the way I look at the world. SciAm always educates and delights me, and inspires a sense of awe for our vast, beautiful universe. I hope it does that for you, too.
If you subscribe to Scientific American, you help ensure that our coverage is centered on meaningful research and discovery; that we have the resources to report on the decisions that threaten labs across the U.S.; and that we support both budding and working scientists at a time when the value of science itself too often goes unrecognized.
In return, you get essential news, captivating podcasts, brilliant infographics, can't-miss newsletters, must-watch videos, challenging games, and the science world's best writing and reporting. You can even gift someone a subscription.
There has never been a more important time for us to stand up and show why science matters. I hope you’ll support us in that mission.