Can anyone me come up with an idea: design an experiment to verify that new substances are formed and heat is
released or absorbed during a chemical reaction

Depending what you have available there are a few different chemicals you can combine to show an obvious reaction without special equipment. Vinegar and Baking soda is a common mixture. Perhaps something like HCl and NaOH mixed will produce heat.