Think about any of the most popular nonfiction books: Atomic Habits, Braving the Wild, Tipping Point, Start with Why, or Lean In. What percent of the writing in these books are stories? Most people will guess 25-30%.  Wrong. When we analyzed the best-selling nonfiction books, 70-80% of these books are story driven.  It’s not just facts, figures, frameworks, and teachings that matter. Stories are what lead to exceptional nonfiction books. Stories make us care, tap into our emotions, and help us learn. And that’s why it’s critical to master the art of story gathering when writing a nonfiction book. 

Mastering the Art of Story Gathering

Modern Authors need to write stories for great books. And to write great stories, you have to gather great stories (or at least gather the raw materials to write into a great story). What kind of story ideas should you look for when writing your nonfiction book? The answer may be obvious — you want story ideas that revolve around real people, places, and events. And learning about them first is an essential part of writing a nonfiction book. As you start the book writing journey, we'll learn and gather content for your book. So, learning before you write is critical: it helps you understand what you want to write about and how your topic fits into the bigger picture. And where to find and gather stories? The great news is that the last few years have unlocked a flood of new story sources: the best I've discovered include podcasts, YouTube videos, blogs, and even social media.   Whenever you're out gathering information, just gather stuff, write up a few notes about it, and you'll be fine. The following example will demonstrate how you can do this as a nonfiction author.  There are usually intersections of things in great books. You might talk about trauma and business executives, or you might talk about your experience, understanding how the male perspective finds happiness, whatever it may be. Let's imagine you're writing a book exploring the intersection of politics and technology.  Sometimes, however, you look at intersections of things, and that's a great place to start. In the case of this book idea, we are going to look at the following:

• Technology 
• Politics 

Great books often explore the intersections of two or more things. Let's say the book title is: The United States of Tech: Can Technology Save Politics?. However, as of now, you have yet to decide where to start. You could be interested in understanding how the world could evolve, but you want to understand polarization and new third-party campaigns. Essentially, what we're going to do here is walk you through the following four steps that might help you discover the book's direction and the book's content. STEP 1: Identify Book Keywords  STEP 2: Hunt for Stories (in everyday places where stories live online)

• Podcasts
• TED Talks
• YouTube
• Google

STEP 3: Capture Intriguing Stories & People  STEP 4: Write Short Notes (Snippets) About Each Thing You Capture

STEP 1: Identify Book Keywords 

As a first step, you will have to define book keywords, which you can use to sort and hunt for books. Keywords are words that describe the topic and central theme of your book. At this point in your book, you may have some theories, ideas, and questions you're exploring. Look at your book description and identify words or phrases. One of the first things that come to mind when discussing technology and politics is the two-party system, third-party candidates, online voting, and social media. Usually, you'll settle on a dozen or so keywords and phrases that are interesting most of the time.  As a result of this process, you can refine things. This is one of those things you will add to and change over time, but you can start by deciding on a few keywords. I like to use the thesaurus, and sometimes I’ll let Google autosuggest help. About fifteen minutes of thinking, exploring, and hunting on the internet can get you a robust list. Example: The United States of Tech: Can Technology Save Politics?

• Keywords
• Technology
• Politics
• Two Party System
• Third-Party Candidates
• Online Voting
• Social Media
• Etc.

STEP 2: Research Typical "Secondary Interview" Sources

You’re going to be writing stories.  Next, we'll look at common secondary sources. We're looking for stories. Ideally, we'd like to hear first-hand accounts of events. You will look for someone on a podcast, Ted talk, or panel to share their experiences.  However, you won't be interviewing them one-on-one to gather information, but you will listen to them as if you were. When searching for content for your book, you should consider four primary platforms:

1. Podcasts (Apple and/or Spotify)
2. TED Talks
3. YouTube
4. Google

Podcasts (Apple and/or Spotify)

Searching on Podcasts is fun and easy. Pick some keywords you think would be relevant, but I suggest picking more specific keyword phrases. In this case, if you just put politics or technology, it will be pretty broad, but if there are some key ones, you should go into those. In this case, we will consider third-party candidates.  There is an idea here about how someone with a third-party candidate could use technology to stand out. So all that we have to do is start by putting that into apple or Spotify.  Example: The United States of Tech: Can technology save politics?

• Go to Apple and/or Spotify
• Search
  • "Third Party Candidates"
  • "Two Party System"

TED Talks

The second one is TED Talks. It has an excellent repository of speakers and speeches, and an algorithm that lets you find "what is similar" to a talk you like. Aside from being transcribed, TED Talks are also searchable, so they are straightforward to use along the way. So we just go to ted.com forward slash talks and add those keywords similarly.  Go to: https://www.ted.com/talks

• Add keywords and search → "Two Party Political Systems"

Find relevant talks (read the transcripts of all the talks) and see what is similar.

YouTube

The third is YouTube, it is a great resource. You'll find a lot of information there. It will require you to do a little searching, but there is amazing content to curate. 

• Go to YouTube
• Add keywords and search → "Two Party Political Systems"

Google

Google is the last one, the fourth one here. Although Google is great, it is also vast. Suppose you put a two-party political system. Generally, you're going to get a lot of stuff from it. The trick is to add little words at the end that can help you. 

1. So the first one is about the two-party political system. You'll see many books when you type them in the search bar. Although I wouldn't suggest reading the entire book, I recommend seeing if anything interesting might be helpful to you. 
2. The next step is to Google two-party political system speeches. You will have many lectures that have come up and covered this subject here. 
3. Lastly, go to scholar.google.com, type in two-party IL system, plus add research. You'll see that a lot of stuff comes up in there. 

Use keywords and add:

• Books → "Two Party Political System" + Books
• Speeches → "Two Party Political System" + Speech
• Research (scholar.google.com) → "Two Party Political System" + Research

STEP 3: Capture Intriguing Stories & People 

Third, we'll begin keeping track of the stories that resonate with us.  In this stage, you'll quickly see you have a lot of names already to work with if you've started this work. Using just one keyword/phrase and the first layer of digging, this is all we have to go on. The list will quickly grow if you keep doing this.  Example: The United States of Tech: Can Technology Save Politics?

Podcast Research

• Ezra Klein
• Lee Drutman

TED research

• Pia Mancini → https://www.ted.com/talks/pia_mancini_how_to_upgrade_democracy_for_the_internet_era
• [TED recommends more like...] Beth Noveck, the former deputy CTO at the White House → https://www.ted.com/talks/beth_noveck_demand_a_more_open_source_government
• [TED recommends more like...] Coder and activist Jennifer Pahlka → https://www.ted.com/talks/jennifer_pahlka_coding_a_better_government#t-1012

YouTube

• Vernon Bogdanor
• Sean Wilentz
• Yanis Varoufakis

Google

• Books:
  • James L. Sundquist
  • Joseph Romance and Theodore J. Romance, Joseph Pomper, Gerald Lowi
• Scholar:
  • William H. Riker

We identified 11 people who could be valuable sources of information.

STEP 4: Write Short Notes (Snippets) About Each Thing You Capture

You don’t need to write the story – just write some notes about it. We call this “snippet” writing. Snippet writing is the informal writing authors do early in the book development process. We encourage you to keep snippets on the shorter side (50-250 words) and do them frequently. As you begin writing more, these snippets will often turn into longer stories, research, and chapters. There's no single way to do snippet writing, but here are some examples to guide you.

• Write whatever comes to your mind, but some common examples of snippets include:
  • Podcasts, YouTube, & Presentation Snippets (notes on interviews, presentations, talks, etc.)
  • Research Driven Snippets (notes on key topics or research on the subject)
  • Personal Story & Moment Snippets (notes on the key moments that matter in your life)
  • Narrative Snippets (notes, ideas, your thoughts)
  • Prior Blogs or Articles Snip (stuff you've written already that can be transformed for the book)

And that’s a wrap. Stories drive great nonfiction books. Most of the best books you’ll read today are filled with insightful, well-written, emotionally-driven stories. You’ve just got to find yours. It’s not just facts, figures, frameworks, and teachings that matter. Stories make us care, tap into our emotions, and help us learn. That’s why it’s critical to master the art of story gathering when you’re writing a nonfiction book.  Stories are what lead to exceptional nonfiction books. Find yours!

---

Eric Koester is the founder and CEO of Creator Institute, a b-corporation whose mission is to inspire, teach and support tomorrow’s creators — authors, podcasters, speakers, entrepreneurs, corporate innovators and course builders. Through his work he’s coached nearly 1,000 first-time creators. He is also a Professor of Entrepreneurship & Innovation at Georgetown University and the school’s only two-time entrepreneurship professor of the year, faculty at Growth University, and the executive director of the Intrapreneur Institute, which researches, trains and develops future innovation leaders.

“So, what do you think of my idea?” When I meet an aspiring author, the most common question they ask me is about their book idea or topic. “Is this a good idea?” “Will readers buy this book?” “Is there a market for this?” Usually, they want to know if it’s a good idea, would make a good book, or could be a bestseller. My response often surprises them. “I’m not concerned about the idea . . . yet, anyways.” I want to know why you’re writing it . . . so we can build a system to write it. Amateur authors make the common mistake of focusing on their idea. Modern authors focus on their writing process. Modern authors talk writing logistics. If you have an amazing idea for a book but no process to write it, you’ll probably never finish the writing. But if you have a writing process that regularly and efficiently gets words on the page, you’ll eventually figure out a killer idea through the writing. 

“You do not rise to the level of your goals. You fall to the level of your systems. Your goal is your desired outcome. Your system is the collection of daily habits that will get you there. This year, spend less time focusing on outcomes and more time focusing on the habits that precede the results.” - James Clear (Atomic Habits)

Systems create outcomes. We just have to build yours. Let’s talk about designing your writing process and your writing systems.

Designing a Writing Process

I’m a big fan of the concept of Design Thinking, an approach pioneered by the Stanford D School to help people iterate and prototype new solutions and products.   Why would design thinking have anything to do with a writing process?  

1. If you’re writing a book, it’ll require a multi-month process. 
2. It’ll require you to write regularly. 
3. It’ll force you to get through ‘writers block’ or periods when you just don’t feel like writing. 
4. You need a process to finish something big. 

Design thinking works because you need to design a process that works for you. The product is your process. So we want to design a solution that will work for you, that can change with you, and that’ll enable you to succeed.   There are five ‘phases’ to design thinking, and we are going to leverage all five to design (and redesign) your writing process:

• Empathize
• Define
• Ideate
• Prototype
• Test

STEP 1: Empathize

This may seem a little counterintuitive, but you are the audience for your writing process. And as much as you probably think you know yourself, it’s often harder than we imagine to truly ‘know thyself.’ This isn’t about an aspirational or hopeful view of ourselves. We want to focus on the actual realities.  Here are the two key questions to ask yourself about designing your writing process:

When I have typically written bigger things (term paper, thesis, work project), what is my style?

• I set aside time every day or multiple times a week and try and chip away at it. (Habit Writing)
• I don’t work on a set schedule, but usually, I write in bigger sessions — 3-6 hours of intense writing — is how I make progress. Usually, several of those are how I write. (Episodic Writing) 
• I get most of my best work done right before its due — sometimes that means late nights or intense pushes, but I get it done. (Deadline Writing)

What makes you most nervous about writing your book?

• I feel uncertain about the book's direction — as I’ve begun to explore, I have doubts if it’s as exciting as I originally thought. (Boredom)
• I feel energized during the sessions, but when I’m working on it by myself, I get in my head. (Loneliness)
• I feel like an imposter — am I qualified to write this, and when it's finished, will it be any good? (Insecurity)
• I am very busy, and I want to do the book, but I'm nervous I have sufficient time. (Fatigue)
• I am not sure I can do it. I’m not a great writer and am worried I can’t write a whole book. (Uncertainty)

STEP 2: Define

I encourage authors to combine these two terms to define themselves — you may want to pick multiple categories in each question, but force yourself to pick the answer that is most like you. This creates a simple way to define yourself. I am a Deadline Writer who struggles with Fatigue. I am a Habit Writer who struggles with Loneliness. I am an Episodic Writer who struggles with Insecurity.

STEP 3: Ideate

Now here’s the fun part. You’ve defined how you typically write (not an aspirational version but your reality), and you’ve defined what makes you most nervous about this writing project. What are ways you could potentially solve this? I am a Deadline Writer who struggles with Fatigue.

• Cut out some activities for the next few months.
• Scope the writing project smaller and set weekly deadlines to deliver content.
• Schedule time each week with a writing group.

I am a Habit Writer who struggles with Loneliness.

• Join a Zoom writers' group.
• Recruit a friend who has wanted to write a book to write hers at the same time.
• Hire an editor and do weekly calls.

STEP 4: Prototype

There are endless solutions you could try, and at this point, you want to pick the idea or approach you’re most intrigued or excited about. Remember, this isn’t the solution . . . it’s a prototype, an experiment, or a trial.   I advise people to prototype a new writing process that you can begin tomorrow and try for two weeks.   How do you prototype? Usually, it’s an incomplete or a partial solution based on what you can do quickly — but it may not be perfect. Here’s an example: I am a Deadline Writer who struggles with Fatigue.

• I am going to schedule time each week with a writing group.

Now you probably can’t find a writers' group that you can join tomorrow, and you don’t want to pay to join a group if you aren’t sure it’s for you. You need to prototype it. How? What does a writers' group require?

• A group of writers
• A shared time to write

Consider this idea. Send out a text message to five people in your life. “I’ve got a writing project I’m working on — looking for a bit of shared accountability. Want to jump on zoom (or meet at a coffee shop) this week for some shared writing time?” If one person says “yes” then you’ve got your group.

STEP 5: Test

Now you’ve got your prototype, and you’re going to run it for two weeks. You need something to test this approach against.   Create a hypothesis: I’d like to write an average of 2,000 words each week for the next two weeks. Write this down.  Run the experiment, and see what happens. If it works, great — now you’ve got a new writing process. If it works for a while and then stops working, go back and change something such as a new prototype or perhaps even a new definition.  

* * *

The writing process isn’t some static system. It’ll evolve and change, but the best part is once you have a process, you can use it to write anything! If you have an amazing idea for a book but no process to write it, you’ll probably never finish the writing. But if you have a writing process that regularly and efficiently gets words on the page, you’ll eventually figure out a killer idea through the writing.  Have fun building your writing process. 

---

Eric Koester is the founder and CEO of Creator Institute, a b-corporation whose mission is to inspire, teach and support tomorrow’s creators — authors, podcasters, speakers, entrepreneurs, corporate innovators and course builders. Through his work he’s coached nearly 1,000 first-time creators. He is also a Professor of Entrepreneurship & Innovation at Georgetown University and the school’s only two-time entrepreneurship professor of the year, faculty at Growth University, and the executive director of the Intrapreneur Institute, which researches, trains and develops future innovation leaders.