I have lived in So Cal for over 26 years, and I remember that this time of year the smell of orange blossoms was so strong, I loved that smell! It seems to have faded away...I guess because houses have replaced the orange groves 
http://www.fillmoreca.com/Simply take a trip to the lovely town of Fillmore. The oranges are in bloom and the aroma will be great. You could take a ride on the historic train at this time. In fact, Hillbilly and Mrs. Hillbilly have possibly done a video about it. If they haven't, I feel sure they will.
While you are there, if there are small kidlets, you could take a small detour off the main highway and see the trout farm. It is truly a treat and the kids can feed the fish.
There is also a wine tasting shop there. Great for us older kids.
Nearby is the town of Santa Paula. Great little town, full of history. And just a short jaunt from there is Ventura and the Pacific Ocean. Many weekends I have taken the trip just to get away from the hustle and bustle of the city.