Hay @Mohr Ben-Reuven
On top of reading the book suggested here, and if you are a fast learner, here is a system that worked for me when I had to supervise a construction with zero experience.
Interview 10 contractors.
For the first 5-7 interview - pick those who you are less likely to work with. Ask them all the questions in the world. Learn from them everything: concepts, terminology, jargon. Ask them to take you to projects they are running right now. To show you what they are proud of. And ask them to show you others' projects - and then ask them what are the mistakes done there (it's easier for someone to point out other people mistakes). Write everything down.
Especially in the beginning don't be afraid to appear ignorant. On the contrary. Say that you don't know much and that you are eager to understand more.
Write down everything they say.
Very important: from one interview to the next - start using their jargon. So it grows on you and it becomes natural for you to say it.
In short - make those interviews your school.
Then, before going further, and armed with all this knowledge you gained - stop interviewing contractors and talk to 2-3 supervisors on the aspects of supervising contractors. Pick their brains. Ask both about what to do and how to manage but also about what pitfalls to avoid. Where are the traps and how can a layman be taken advantage of.
Finally, when you hit the 8th interview - you will know so much about the subject, be able to use jargon and demonstrate knowledge and control such that it will allow you to both vet the contractor and also leave an impression that you cannot be fooled or taken advantage of.
This is not an orthodox way, but if you are a fast learner, brave and determined this might get you up to speed in a relatively short and intense time.