Word used to refer to art, music or literature that is modern or experimental (5-5)
I believe the answer is:
avant-garde
(Other definitions for avant-garde that I've seen before include "In the arts, radically new and daring" , "Daringly innovative or unconventional" , "Experimental (art)" , "New and experimental" , "Radical - daring" .)