When a member of your village specializes in an activity, spending at least 8 hours per day performing a single task, they become experts in the area. As a specialist, they receive a bonus of 25%, meaning that every 4 hours they spend accomplish 5 hours worth of work.
When two members of your village work as a team they can do more. Through teamwork and division of labor, a pair of workers can accomplish 25% more than one person working alone; so 2 people working for 2 hours accomplish 5 total hours of work.
(Note: If more than one bonus applies, they are applied to the base number of hours and then added on. You do not get a bonus multiplied by another bonus. So if two people work for 8 hours each, you would get 16 base hours a day. Calculate 16 ∙ 0.25 = 4 hours bonus for specializing and 16 ∙ 0.25 = 4 hours bonus for teamwork. Therefore, 16 + 4 + 4 = 24 hours of labor accomplished.)
As I am sure you noticed, there is more labor available than is needed to complete all the tasks. This extra time can be left unused, providing extra leisure time to your villagers, or it can be used to grow. Consider the ideas below.
If you continually produce more food than you need and provide more buildings than you occupy, your village will grow. A larger community can do more, grow more, and protect more…but there are also more problems. Is this something your village wants?
If your village is devoted to scouting new areas around your location you will find people and eventually other villages. People may join your village if there are room and food. Other villages might be willing to trade with you. Or, they could become an enemy. Do you want to look, or hide?
If your village spends extra efforts on practicing military actions you will be better prepared to defend against attackers who are drawn to the riches you gather. You also would be better prepared to attack other peace-loving villages that may be around you, but it is best not to discuss that.