I've noticed that attacking mana producers early is a waste but many times devoting a small creature to attacking them during the mid game can be useful. If your opponent has a few big creatures he has to either devote a large creature to defending or have them die after a few turns of attacking. The starting turns are far too important for setting up your board presence to worry about destroying them.