It’s gray by default. To make it transparent:

/* -- START Change caption background color -- */
.wp-caption {
background-color: rgba(0,0,0,0);
}
/* -- END Change caption background color -- */Code language: CSS (css)