Are the opening/ending themes, insert songs, and background music created specifically for the series they represent, or are they just picked by the producers/production committee based on how well they would fit their series? What typically happens?
In most cases, opening/ending themes, insert songs, and background music are created specifically for the series they represent. Though, it can also be picked based on it's popularity. After all, the main objective is to promote both the series and the theme songs.
What exceptions are there?
About exceptions, which I think can only be applicable when picking a song depends on the deal between the companies (anime production/company and music company) whether they will allow a song to be used as an anime theme song. Well, anime can be a good promoter of a theme song and vice versa so it's a win-win deal for the companies, so exceptions I guess will be all inside their agreement.
How much have things changed now compared to the past?
I think the only thing that has changed pertaining anime theme songs are the popularity. Anime are more popular now than before globally so there is more opportunity of a theme song to have a different versions of languages (which involves purposely creating theme songs for the anime itself).
My basis is here,
The theme music for most anime tends to be catchy songs deliberately written for release to the pop/rock music market, if they aren't
already actual pop/rock songs.
One reason is simply that anime
provides an easy way for both hit and entry J-pop/J-rock artists to
get more exposure and good lateral promotion. Platinum J-rock bands
like L'Arc~en~Ciel and Orange Range frequently release their new songs
along as themes in anime that are on the air at the same period as
their respective singles or albums.
Another reason this is done is because many anime voice actors are
also singers, often the more successful ones. (At least one such
performer, Megumi Hayashibara, is both a formidable presence on
Japanese pop charts and an internationally-known talent, as well as
the recipient of more star and featured anime roles than any one
person ought to have.) It's not unknown for production companies to
organize some of their principal cast members into groups for
recording CDs — the "Goddess Family Club" (Ah! My Goddess), DoCo
(Ranma 1/2), the Maho-Dou (Ojamajo Doremi) and the Spirit Singers
(Digimon Frontier) all come to mind. Either way, it's usually to a
voice actor's advantage — they perform theme songs (as well as
additional "character" songs), receiving a double benefit from
exposure in two different markets (and the additional profit).
A third reason is that TV theme songs are the pinnacle of Japanese
musical success. If a Japanese artist/group makes a hit album, the
studio takes almost all of the profits. If the same group makes an
album as a TV tie-in, the musicians themselves receive a much larger
cut.