How do you remove options from the Rich Text Editor?

I want to trim the options down to just a few basic options like bold, underline, and italic . How do I remove unwanted buttons from the Rich Text Editor (font button, color button etc)?

I'm thinking I can do this somehow with JavaScript and CSS.