I have tried to read Homer's Odyssey and commentaries to find out details about how Odysseus's shipwreck happened, how many men were involved and saved and so forth. It looks like the first book starts when Odysseus was already in the Ogygia island, and information is scattered to several books. Is there a good summary giving this kind of information about this famous story?
This is detailed in book 12 of the Odyssey. Odysseus' crew disobeyed his (and the gods') command not to eat the cattle of Helios, which led to Helios' and Zeus' displeasure. So Zeus sends a storm destroying the survivors, as they had just made it through Scylla and Charybdis. Odysseus is swept back to the latter, and sort of just floats on to Ogygia.
You can read the passage yourself on Theoi. Start from line 374.