When do you start discipline

How old does a child need to be when you start to discipline them? My 21 month old does things that she KNOWS is wrong. Should we punish her?

Currently, we just correct the behavior, but I wonder if we aren't being too easy on her.