The way I remember it is that Japan in sometimes known as "land of the rising sun" and is in the East (relative to the UK/Europe - other parts of the world may need to think of other ways to remember it). The sun rises in the East and sets in the West. It forms an arc in the sky, reaching it's highest point at noon (which isn't exactly 12:00 as it varies with location).
It varies by time of year and location and can get complicated but you can find websites that show it as a diagram and it's a lot easier to explain visually.
http://physics.weber.edu/schroeder/ua/sunandseasons.html
Shadows always point away from the sun, and the higher the sun is in the sky, the shorter the shadow. If the sun's directly overhead (this only happens in the tropics*) then your shadow's like a puddle under your feet. The lower the sun is in the sky, the longer the shadow.
*i.e. places located between the Tropic of Cancer and the Tropic of Capricorn
You do not need to go into that much detail though for most stories, in fact, it's likely to bog the reader down in too many intricate details, especially as very few people know how to make a sundial or tell the exact time of day from the sun's position so it won't be easy to relate to. If you do need this info, there are websites that can calculate stuff like this. For most stories, things like "the shadows started to grow long" or "the sun was low in the sky" would indicate late afternoon, and that would be all that you need.
Early morning light has more of the blue light frequencies and evening light has more of the red. This is to do with the way the light is scattered through the atmosphere. The sun, of course, always emits the same frequencies (i.e. all of them and very intensely). The sky can appear red in the morning, but the light that falls on things still has a slight blueish tinge. The folk wisdom over here (UK) is that a red sky in the morning is a sign that the weather's not going to be very good, as in the saying "red sky in the morning, shepherd's warning; red sky at night, shepherd's delight." (Though as the weather over here's very often bad, it brings to mind a Scottish saying: "if you can see the tops of the mountains, it's going to rain. If you can't see the tops of the mountains, it's already raining"
) But when it comes to descriptions in books, if you describe for example the early morning light having a slight blueish tinge, or the reds, oranges and golds of the late afternoon light it can add a really nice touch.
One of my WIPs is set 40,000 years ago and the only indication of time of day is what the sun's doing so my MC's often making observations about the sun, e.g. "the sun's high in the sky" = around noon. He doesn't think in modern terms of times of day (noon, four o'clock in the afternoon, etc), the only time reference is the position of the sun. i.e. it's not: "the sun's high in the sky, it must be noon" just "the sun's high in the sky" - the reader can infer that it's around noon/middle of the day. Sun getting higher in the sky = morning; sun getting lower in the sky = afternoon. Most stories won't need much more detail than this, and you can relate the info in the way that would make sense to your POV character.