How to locate Shinkansen station on map?

Hey guys,

I am looking at the map and got some confusion. For example, when I look at the map of Osaka, there are multiple Stations, such as:
- Osaka Station (near Umeda) - JR-Namba Station (near Namba) Both stations are marked in same symbol.

If I want to catch a Shinkansen. which station do I need to get to? (I guess JR-Namba would be the one, because there's a "JR"). However, I just to make sure, and I also want to know in other map of other cities, is there any hint or tip that can help me locate the correct station for shinkansen immediately? Or all station will have Shinkansen?

Thank you guys for your response.