jQuery removeClass wild card
HTML
<div id="hello" class="color-red color-brown foo bar"></div>
JavaScript
$("#hello").removeClass (function (index, class) {
return (class.match (/\bcolor-\S+/g) || []).join(' ');
});
console.log($("#hello"));