Here is a quick Google list of books that would be appropriate.
Beautiful Oops! by Barney Saltzberg: A hands-on book showing how torn paper, spills, and smudges can become something new.
The Book of Mistakes by Corinna Luyken: Explores how an artist turns accidental, imperfect lines into a beautiful, finished illustration.
Eraser by Anna Kang: Follows an eraser who learns that mistakes are part of the creative process and that fixing them is valuable.
MoMA Make Art Mistakes: An Inspired Sketchbook (Museum of Modern Art): A prompt-filled book encouraging kids to intentionally make and fix mistakes.
It's Okay to Make Mistakes by Todd Parr: Reassures children that accidents and mistakes in art are part of learning and growing.
The Art of Mistakes by Melanie Rothschild: Provides, for slightly older elementary, 16 techniques to turn artistic mishaps into creative, unexpected art.
Bear in a Square by Stella Blackstone
Black All Around by Patricia Hubbell
Color by Ruth Heller
Color Farm by Lois Ehlert
Color Zoo by Lois Ehlert
Ella Sarah Gets Dressed by Margaret Chodos-Irvine
Ellsworth's Extraordinary Electric Ears by Valorie Fisher
For Pete's Sake by Ellen Stoll Walsh
Fran's Flower by Lisa Bruce
Harold and the Purple Crayon by Crockett Johnson
I Am an Artist by Pat Lowery Collins
Joseph Had a Little Overcoat by Simms Taback
Lots and Lots of Zebra Stripes: Patterns in Nature by Stephen R. Swinburne
Lunchtime for a Purple Snake by Harriet Ziefert
Messenger, Messenger by Robert Burleigh
Mouse Paint by Ellen Stoll Walsh
No One Saw: Ordinary Things Through the Eyes of an Artist by Bob Raczka
Pie in the Sky by Lois Ehlert
Planting a Rainbow by Lois Ehlert
Rain by Manya Stojic
Snowballs by Lois Ehlert
The Crayon Box That Talked by Shane DeRolf
The Shape of Me and Other Stuff by Dr. Seuss
There's a Cow in the Cabbage Patch by Clare Beaton
Where Is the Green Sheep? by Mem Fox
A String of Beads by Margarette S. Reid
Black All Around by Patricia Hubbell
Butterflies for Kiri by Cathryn Fallwell
Butterfly Boy by Virginia Kroll
Color Dance by Ann Jonas
Color Zoo by Lois Elhert
David's Drawings by Cathryn Fallwell
Elmer by David McKee
Ellsworth's Extraordinary Electric Ears by Valerie Fisher
Joseph Had a Little Overcoat by Simms Taback
Katie Meets the Impressionists by James Mayhew
Lines by Philip Yenawine
Snowballs by Lois Elhert
The Art Box by Gail Gibbons
The Art Lesson by Tomie dePaola
The Crayon Box That Talked by Shane DeRolf
The Starry Night by Neil Waldman
White Rabbit's Color Book by Alan Baker
A Blue Butterfly: A Story About Claude Monet by Bijou Le Tord
Abuela's Weave by Omar S. Casteneda
Chameleon's Colors by Chisato Tashiro
Charlie Needs a Cloak by Tomie dePaola
Degas and the Little Dancer: A Story About Edgar Degas by Laurence Anholt
Harold and the Purple Crayon by Crockett Johnson
How Artists See Animals: Mammal Fish Bird Reptile by Colleen Carroll
I Am an Artist by Pat Lowery Collins
In the Garden with Van Gogh by Julie Merberg and Suzanne Bober
Little Blue and Little Yellow by Leo Lionni
Little Mouse's Painting by Diane Wolkstein
Lots and Lots of Zebra Stripes: Patterns in Nature by Stephen R. Swinburne
Lunch by Denise Fleming
Lunchtime for a Purple Snake by Harriet Ziefert
Mailing May by Micheal O. Tunnell
Mouse Paint by Ellen Stoll Walsh
Nine-in-One GRR! GRR! by Blia Xiong (adapted by Cathy Spagnoli)
No One Saw: Ordinary Things Through the Eyes of an Artist by Bob Raczcka
Pattern Fish by Trudy Harris
Peter's Painting by Sally Moss
Rainbow Joe and Me by Maria Diaz Strom
Roberto: The Insect Architect by Nina Landen
The Shape of Me and Other Stuff by Dr. Seuss
The Story of the Statue of Liberty by Betsy Maestro
When a Line Bends... A Shape Begins by Rhonda Gowler Greene
Art Dog by Thacher Hurd
Color by Ruth Heller
Diego by Jeanette Winter and Jonah Winter
Gugu's House by Catherine Stock
Harold and the Purple Crayon by Crockett Johnson
Hello, Red Fox by Eric Carle
Lunchtime for a Purple Snake by Harriet Ziefert
Matthew's Dream by Leo Lionni
Me and Uncle Romie: A Story Inspired by the Life and Art of Romare Bearden by Claire Hartfield
Micawber by John Lithgow
My Name is Georgia by Jeanette Winter
Peter's Painting by Sally Moss
Sunflower Sal by Janet S. Anderson
The Art Room by Susan Vande Griek
The Class Artist by G. Brian Karas
The Hatmaker's Sign: A Story by Benjamin Franklin by Candace Fleming
The Seeker of Knowledge: The Man Who Deciphered Egyptian Hieroglyphs by James Rumford
A Cloak for the Dreamer by Aileen Friedman
Action Jackson by Jan Greenburg and Sandra Jordan
Butterflies for Kiri by Cathryn Fallwell
Can a Coal Scuttle Fly? by Camay Calloway Murphy
Diego by Jeanette Winter and Jonah Winter
Jumanji by Chris Van Allsburg
The Art Room by Susan Vande Griek
The First Starry Night by Joan Shaddox Isom
The Legend of the Indian Paintbrush by Tomie dePaola
The Talking Cloth by Rhonda Mitchell
The Young Artist by Thomas Locker
What Makes a Degas a Degas by Richard Muhlberger
A Cloak for the Dreamer by Aileen Friedman
Action Jackson by Jan Greenberg and Sandra Jordan
Gugu's House by Catherine Stock
I Dreamed I Was a Ballerina by Anna Pavlova
Linnea in Monet's Garden by Christina Bjork
Painters of the Caves by Patricia Lauber
Sunflower Sal by Janet S. Anderson
Suzette and the Puppy: A Story About Mary Cassatt by Joan Sweeny
The Apprentice by Pilar Molina Llorente
The Pot That Juan Built by Nancy Andrews-Gobel
The Young Artist by Thomas Locker
When Clay Sings by Byrd Baylor
A Day with No Crayons by Elizabeth Rusch
An ABC of What Art Can Be by Meher McArthur
Art by Patrick McDonnell
Art & Max by David Wiesner
Chalk by Bill Thomson
Dog Loves Drawing by Louise Yates
Emily's Blue Period by Cathleen Daly
Frida by Jonah Winter
I Ain’t Gonna Paint No More! by Karen Beaumont
I Am A Rainbow by Dolly Parton
Isabel and Her Colores by Alexandra Alessandri
Ish by Peter H. Reynolds
Let’s Paint by Gabriel Alborozo
Lines that Wiggle by Candace Whitman
Seymour Bleu by Catherine Deeter
Sky Color by Peter H Reynold
The Artist Who Painted a Blue Horse by Eric Carle
The Beautiful Oops by Barney Saltzburg
The Day the Crayons Quit by Drew Daywalt
The Dot by Peter H. Reynolds
The First Drawing by Mordicai Gerstein
The Jellybeans and the Big Art Adventure by Laura Numeroff
The Line by Paula Bossio
The Pencil by Allan Ahlberg
The Rainbow Fish by Marcus Pfister
Too Much Glue by Jason Lefebvre
Why is Blue Dog Blue by George Rodriguez
Anansi the Spider by Gerald McDermott
Ape in a Cape by Fritz Eichenberg
Black and White by David Macaulay
Dave the Potter by Laban Carrick Hill
Grandfather's Journey by Allen Say
Make Way for Ducklings by Robert McCloskey
Raven by Gerald McDermott
Tar Beach by Faith Ringold
The Biggest Bear by Lynd Ward
The Boy of the Three-Year Nap by Dianne Snyder
The Desert Is Theirs by Byrd Baylor
Tuesday by David Wiesner
When I Was Young In The Mountains by Cynthia Rylant
Why The Sun and The Moon Live In The Sky by Elphinstone Dayrell