Educators do require citing and referencing sources (so they can check up on you and make sure you didn't make them up), but when it comes to a memoir, it's not a requirement. Especially in this day and age when you can google for primary source material easily. What I did in my memoir is every time I reference a primary source in the narrative, I make it clear where it can be found by googling.
If you were writing a non-fiction "history book", footnotes, endnotes, and a comprehensive list of sources would be part and parcel of your manuscript. However, a memoir gives you a certain amount of creative freedom, so that you can present material without having the citations interrupt the flow of the narrative.
However, it sounds as though you are presenting material that might be of interest to people who would want to do further research on the subject, so adding an afterword, bibliography, etc., as an aid to that further research is something your readers would probably appreciate.
This is something that your publisher and editor will most likely work with you on to ensure that your readers get the most out of their experience.
Sounds like an interesting story, btw.
Focus