Why you should take notes if you use AI — Transcript

Vicky Zhao explains why a note-taking system is essential for effective AI use, emphasizing context engineering over prompt engineering.

Key Takeaways

  • Start a note-taking system to improve AI output quality and thinking.
  • Context engineering is more important than prompt engineering for AI communication.
  • Explicitly define inputs, sources of truth, and judgment criteria in notes for AI.
  • Use frameworks or examples to help AI understand what good output looks like.
  • Proper note-taking enables deeper cognitive engagement rather than outsourcing thinking.

Summary

  • The shift from prompt engineering to context engineering makes note-taking crucial for AI users.
  • Notes help convert tacit knowledge into explicit knowledge, improving communication and collaboration.
  • Effective communication with AI requires clear context, including role, goals, audience, style, and constraints.
  • Context engineering involves specifying inputs, sources of truth, and judgment frameworks for AI.
  • Frameworks help articulate quality standards and improve AI output by guiding its evaluation criteria.
  • Users can teach AI their own frameworks by providing examples of good and bad outputs.
  • A well-maintained note system enhances AI's ability to summarize, spot patterns, and assist deeper thinking.
  • Outsourcing thinking to AI without notes can lead to disengagement and lower quality output.
  • Proper use of AI with notes can deepen engagement and expand mental capacity.
  • Vicky demonstrates practical application using her Obsidian vault to improve AI interaction and thinking quality.

Full Transcript — Download SRT & Markdown

00:00
Speaker A
If you use AI and you don't have a note-taking system, you have to start one now.
00:10
Speaker A
And the reason lies in the clear trend that we're moving away from prompt engineering.
00:17
Speaker A
And the increasing importance of context engineering, having used these tools for two plus years.
00:26
Speaker A
I can really say that having the right context, having the right notes to be able to set up what you actually wanted, what you want these LLMs, whether it's ChatGPT, Claude, Gemini, whoever, to be able to draw upon the quality of the output is going to be different.
00:39
Speaker A
As well as the quality of thinking you can put into it.
00:43
Speaker A
Everyone's complaining that, you know, we have to outsource thinking, it doesn't have to be that way, but if you don't have notes, then, yeah, there's no choice.
00:52
Speaker A
I've talked about this in another video that you can explore here.
00:56
Speaker A
Which is it is so important to turn tacit knowledge, knowledge that just exists in our head.
01:04
Speaker A
And we cannot articulate into explicit knowledge.
01:10
Speaker A
So that we can share with other people.
01:14
Speaker A
Which is the source of why note-taking came into place, right?
01:19
Speaker A
Before, level one was just us and our brain.
01:23
Speaker A
We have things swirling in it and because we kind of know where they are.
01:29
Speaker A
We say, okay, that's fine, right?
01:32
Speaker A
Don't need to write anything down.
01:34
Speaker A
Until the second iteration, we developed writing systems.
01:40
Speaker A
And we realized, okay, there are things that we need to unload.
01:45
Speaker A
In order for our brains to do more.
01:48
Speaker A
So that's why we started to translate this tacit knowledge into explicit knowledge.
01:53
Speaker A
Because then we can work with other people.
01:55
Speaker A
Right, so as we're talking about on this channel.
02:00
Speaker A
It really is very important to recognize that communication is not about performance.
02:07
Speaker A
Of course, for for some people who are, I don't know, motivational speakers or whatever.
02:12
Speaker A
I guess the performance side is also important.
02:15
Speaker A
But for people who are working on ideas, knowledge workers.
02:20
Speaker A
Right, why we need to communicate clearly is not to look good, but to get the tacit knowledge into explicit knowledge.
02:27
Speaker A
And to share with other people so they can understand and we can take action together.
02:32
Speaker A
With as little friction as possible.
02:35
Speaker A
Right, and vice versa.
02:37
Speaker A
When they're saying something, we can process it and understand it.
02:41
Speaker A
Which is why frameworks are really important.
02:43
Speaker A
But that is the core of communication.
02:45
Speaker A
And now we're adding on another layer of it's not just us and other people.
02:50
Speaker A
But there's also an AI that has access to other kinds of information.
02:55
Speaker A
So we can put it together.
02:58
Speaker A
And all move forward.
03:00
Speaker A
And having a note-taking system that has the important information that the LLMs can use makes everything better.
03:08
Speaker A
It then you can use it to work on the things that take you a lot of time.
03:12
Speaker A
And I'll show you an example in just a moment.
03:15
Speaker A
But just want to iterate why you must have a note-taking system and have information downloaded from your brain.
03:24
Speaker A
Onto something that LLMs can read.
03:28
Speaker A
And then use its superpower to be able to summarize, to be able to spot patterns.
03:33
Speaker A
All of those good stuff.
03:34
Speaker A
Okay.
03:35
Speaker A
So that's part number one.
03:37
Speaker A
Now, what do we actually put into the notes then?
03:41
Speaker A
What kind of notes do we need to have?
03:43
Speaker A
Well, luckily, there are just six categories.
03:46
Speaker A
We have to think about.
03:48
Speaker A
And I'm drawing straight from context engineering.
03:52
Speaker A
Because to be able to communicate with AI, we might as well use its rules.
03:58
Speaker A
And its way of thinking.
04:00
Speaker A
So we mentioned three already that mostly are covered in prompt engineering.
04:06
Speaker A
Which is we have to give it a role.
04:10
Speaker A
And then give it some general idea about the goal and the audience.
04:15
Speaker A
That is going to use that output.
04:18
Speaker A
Then also we want to give it some constraints around style or formats.
04:22
Speaker A
These kinds of things.
04:24
Speaker A
Most people know this part already.
04:26
Speaker A
Now, the next three things are more covered in context engineering.
04:32
Speaker A
And also notes that we want to have.
04:35
Speaker A
Which are about the inputs.
04:38
Speaker A
The source of truth.
04:40
Speaker A
As well as judgment.
04:43
Speaker A
Okay.
04:44
Speaker A
So by input, I mean for the LLM.
04:49
Speaker A
You know, what's the data?
04:52
Speaker A
Just in general that it can use.
04:54
Speaker A
So for example, for me, everything in my vault, you know, in my Obsidian vault, it can use.
05:00
Speaker A
Or it maybe is, okay, there maybe there's some personal things or sensitive things or confidential things.
05:07
Speaker A
I don't want it to use.
05:10
Speaker A
Then I can also say, okay, use everything in my vault.
05:13
Speaker A
Except for these tags.
05:15
Speaker A
Right, you want to be able to tell it explicitly.
05:19
Speaker A
What's the input it can use.
05:21
Speaker A
Number two is the source of truth.
05:24
Speaker A
So what kind of documents outrank its generic information?
05:28
Speaker A
Right, so for example, when you have a do not use, it means, yes, you have these things in your general information.
05:35
Speaker A
But I don't want you to use them.
05:38
Speaker A
That's a source of truth.
05:40
Speaker A
So that it knows, okay, I'm not going to rely on those.
05:45
Speaker A
I'm going to focus specifically on these documents.
05:48
Speaker A
Then the third one is judgment.
05:51
Speaker A
So how does LLMs judge what is good, what is bad?
05:55
Speaker A
Right, this is especially where we need to take tacit knowledge into explicit knowledge and luckily there are frameworks to do this.
06:06
Speaker A
And frameworks help us better articulate what's good and what's bad.
06:10
Speaker A
So that's the type of notes.
06:12
Speaker A
That we're going to take.
06:14
Speaker A
A quick note on frameworks.
06:16
Speaker A
I think if you've used AI for a while, then you probably noticed.
06:22
Speaker A
It has several frameworks that it keeps on using.
06:25
Speaker A
Right, for example, for formatting, it uses the heading options so that as it goes through, it organizes things by headings.
06:33
Speaker A
Or it likes to say a lot, like it is not this.
06:37
Speaker A
It is that.
06:38
Speaker A
Right, a great little via negativa there.
06:40
Speaker A
But the problem with its frameworks is it keeps on using the same ones.
06:44
Speaker A
And it keeps on using very generic ones when it produces output.
06:49
Speaker A
But to be able for you to judge what's good or what's bad.
06:55
Speaker A
A lot of the time, a simple way of doing that is to say, okay, write me a sales letter.
07:00
Speaker A
Right, and mostly the LLM might use AIDA.
07:05
Speaker A
Like something that's very basic in copywriting.
07:08
Speaker A
But if you have a different framework, you would like it to focus on.
07:13
Speaker A
Then just share that one.
07:15
Speaker A
Right, and this way you are inherently building what's good into your prompt and your context.
07:22
Speaker A
So that you don't have to worry about how does it judge, I don't know, like intuitively I look at it.
07:28
Speaker A
It's pretty good.
07:30
Speaker A
Right, instead.
07:32
Speaker A
What you can do is give it a framework.
07:34
Speaker A
Or if really you don't have any frameworks, but you have examples of what's good and what's bad.
07:40
Speaker A
It would be great to have.
07:42
Speaker A
You know, the good and the bad so that you can get your LLM.
07:47
Speaker A
To figure out what is the what is the framework underneath.
07:50
Speaker A
And the other thing about LLMs is they're great at distilling.
07:55
Speaker A
Right, as long as you give it information, it's pretty good at distilling.
07:59
Speaker A
So what you can do is if you have 10 examples of things that you think are great and 10 examples of things that you think are terrible.
08:06
Speaker A
Get the LLM to create that framework for you.
08:10
Speaker A
Right, help me articulate what makes these examples great and what are the patterns of the bad ones.
08:16
Speaker A
Right, then you've got your own framework that you can use next time.
08:20
Speaker A
Consciously.
08:22
Speaker A
So that is a great way of injecting framework in a way that helps you get the outcome that you want.
08:27
Speaker A
All right, I'll give you an example from my actual Obsidian vault.
08:32
Speaker A
So that you can see how not only the quality of the output changes.
08:40
Speaker A
Also the quality of the thinking changes.
08:43
Speaker A
And I really believe that, yes, working with AI can absolutely make us dumb.
08:50
Speaker A
And studies have shown, right, if we just outsource our thinking.
08:55
Speaker A
Then, yes, as we go on, quality of the output drops.
09:00
Speaker A
Also we are disengaged from the thinking experience.
09:03
Speaker A
But that's not the only way to use LLMs.
09:06
Speaker A
And studies have also found.
09:08
Speaker A
Depending on how you use it, right, you can deeply engage it.
09:15
Speaker A
Actually think deeper and access things that you didn't have the mental capacity to do before.
09:20
Speaker A
And really what is holding us back from being more engaged in the thinking process.
09:28
Speaker A
Is have we downloaded the context out from our brain and into the LLM?
09:34
Speaker A
So when we have a conversation, it's an intelligent one.
09:38
Speaker A
It's one that's based on the information that we want it to work with.
09:42
Speaker A
Right, so if you feel like, okay, I'm just getting dumber by the day using ChatGPT or whoever.
09:50
Speaker A
Then you have to also ask yourself, am I also just consuming and not processing?
09:55
Speaker A
Outputting documents.
09:57
Speaker A
That I can feed my LLM.
09:59
Speaker A
Because if you're not doing that process, right, then there is not much context to share.
10:04
Speaker A
Right, because it's difficult, not every single time you're there.
10:10
Speaker A
You want to start typing out the context.
10:13
Speaker A
It's very time-consuming.
10:15
Speaker A
There's a lot of friction.
10:17
Speaker A
Which is why taking notes as a habit then help you just drag and drop the context into the LLM.
10:23
Speaker A
And your conversation with it.
10:25
Speaker A
Right, so if you feel like, okay, this is what I'm missing.
10:31
Speaker A
Then let me just show you how significantly things can change.
10:34
Speaker A
For the example, I'm going to use a problem a lot of us on this channel face.
10:40
Speaker A
Which is I'm multi-passionate.
10:43
Speaker A
I'm interested in a bunch of stuff.
10:45
Speaker A
But I feel so scattered all the time.
10:50
Speaker A
All I know is I don't want that singular track career or, you know, life goals.
10:55
Speaker A
That other people have.
10:56
Speaker A
By the same time, I don't know how do I focus in order to get to where I want to go.
11:01
Speaker A
Like there must be something that can tie everything together.
11:04
Speaker A
So, let's talk about that and let me show you the difference between talking to.
11:10
Speaker A
I'm going to use ChatGPT here in incognito.
11:15
Speaker A
Versus using your own context.
11:18
Speaker A
So I'm going to share my Obsidian vault.
11:21
Speaker A
In a moment.
11:22
Speaker A
But let's give this a try.
11:24
Speaker A
Okay.
11:25
Speaker A
So what we can do with ChatGPT is I'm interested in creativity and frameworks.
11:30
Speaker A
The two seems contradictory.
11:33
Speaker A
Help me see how to combine these two interests together into a career that makes sense.
11:37
Speaker A
Let's see what it says.
11:38
Speaker A
I haven't really shared anything.
11:40
Speaker A
But let's see what it says.
11:42
Speaker A
Blah, blah, blah.
11:43
Speaker A
Blah, blah, blah.
11:44
Speaker A
Where is the.
11:45
Speaker A
Design thinking, product strategy.
11:48
Speaker A
Okay.
11:49
Speaker A
Creative direction with systems.
11:51
Speaker A
Creative director.
11:52
Speaker A
Brand strategist.
11:53
Speaker A
I mean.
11:54
Speaker A
I guess, but, you know, for example, the career I'm thinking about is not like these roles.
11:59
Speaker A
But of course, I didn't tell it.
12:01
Speaker A
So, okay, makes sense.
12:03
Speaker A
It's saying something like this.
12:04
Speaker A
Yeah.
12:05
Speaker A
Okay, so I'm kind of in this category, the framework builder, thought leader kind of.
12:09
Speaker A
Learning design.
12:10
Speaker A
I mean, these are things I'm interested in.
12:12
Speaker A
But just seeing this list doesn't really help me say, okay.
12:16
Speaker A
So how do I know which one's for me?
12:19
Speaker A
And I guess they all sound good.
12:21
Speaker A
But how do I prioritize them?
12:23
Speaker A
Let me ask it.
12:24
Speaker A
How do I prioritize this?
12:26
Speaker A
Okay.
12:27
Speaker A
Great question, this is the right place to feel stuck.
12:30
Speaker A
Prioritization is where creativity.
12:32
Speaker A
Frameworks either click.
12:33
Speaker A
Or spiral.
12:34
Speaker A
Let's make it simple and actionable.
12:36
Speaker A
I'll give you one clear prioritization model.
12:38
Speaker A
Not a buffet.
12:39
Speaker A
The rule of thumb, anchor this.
12:41
Speaker A
Prioritize the intersection, not the options.
12:43
Speaker A
You're not choosing between.
12:44
Speaker A
Creativity versus structure.
12:45
Speaker A
Learning versus doing.
13:24
Speaker A
Ask.
13:26
Speaker A
Am I turning intuition into something legible?
13:28
Speaker A
Good signs.
13:29
Speaker A
Explaining why something works.
13:35
Speaker A
If it's only.
14:41
Speaker A
Okay.
14:42
Speaker A
Let's say something like this.
14:43
Speaker A
And see what kind of recommendation it will come up with.
14:45
Speaker A
Okay.
14:46
Speaker A
So five minutes later, here is what it shared.
14:48
Speaker A
I really recognize a lot of these books.
14:50
Speaker A
But.
15:25
Speaker A
But.
15:26
Speaker A
These, these are good.
15:27
Speaker A
I mean, definitely know some of these.
15:29
Speaker A
The recommendations.
15:30
Speaker A
I've written them.
15:31
Speaker A
But, um, all right.
15:32
Speaker A
That's good to know.
15:34
Speaker A
I would now come back to the question of the career.
15:48
Speaker A
Okay, let's say something like this.
15:50
Speaker A
And see what kind of recommendation it will come up with.
15:53
Speaker A
Okay, here we go.
15:55
Speaker A
Um, it's mentioned.
15:57
Speaker A
Okay, so first of all, the positioning.
15:59
Speaker A
It knows what I'm doing.
16:00
Speaker A
I'm glad this showed up.
16:01
Speaker A
As in, yeah, great.
16:02
Speaker A
Um, the gap you could fill, productivity influencer, tactics without theory.
16:07
Speaker A
Academic, theory without practice.
16:10
Speaker A
AI tool builders.
16:11
Speaker A
Tools without methodology.
16:12
Speaker A
Corporate L&D.
16:13
Speaker A
Generic, not practitioner-led.
16:15
Speaker A
Business authors.
16:16
Speaker A
Frameworks without depth.
16:17
Speaker A
Yeah, these are great, the gap is someone who can articulate how knowledge work actually works.
16:23
Speaker A
With philosophical depth, practical frameworks, and AI fluency.
16:27
Speaker A
And translate that into teachable, applicable methods.
16:30
Speaker A
Honestly, this is how I feel.
16:33
Speaker A
I mean, I never really mentioned this in my notes.
16:36
Speaker A
So it's kind of crazy that it articulated this.
16:39
Speaker A
Um, building intellectual property through writing.
16:42
Speaker A
I am writing a book currently.
16:44
Speaker A
I don't know about the book to speaking to corporate workshop to advisory type.
16:49
Speaker A
Revenue stream.
16:50
Speaker A
Yes, I know.
16:51
Speaker A
These are awesome people do it.
16:52
Speaker A
Okay.
16:53
Speaker A
The educator builder.
16:55
Speaker A
Okay.
16:56
Speaker A
The applied researcher.
16:58
Speaker A
Work inside AI companies.
17:00
Speaker A
I don't really want to do that.
17:01
Speaker A
Hybrid phase one.
17:02
Speaker A
Now, 18 months.
17:03
Speaker A
Deepen your methodology.
17:04
Speaker A
Continue content but shift towards original frameworks.
17:07
Speaker A
Not just explaining others.
17:09
Speaker A
Run small paid workshops to test what resonates.
17:11
Speaker A
Document everything, this becomes your book material.
17:13
Speaker A
Phase two.
17:14
Speaker A
18 months to three years.
17:15
Speaker A
Productize.
17:16
Speaker A
Launch a signature course cohort on your methodology.
17:18
Speaker A
Or write the book and use it to unlock speaking corporate.
17:20
Speaker A
Build a small team to scale delivery.
17:22
Speaker A
Phase three.
17:23
Speaker A
Three plus years.
17:24
Speaker A
Choose your leverage.
17:25
Speaker A
License your methodology to organizations.
17:27
Speaker A
Build advise AI tools for knowledge work.
17:29
Speaker A
Or go deep on research, academic partnerships, think tank, etc.
17:31
Speaker A
Clarifying questions.
17:32
Speaker A
Before I go deeper, it would help to know.
17:34
Speaker A
What's your current revenue model, YouTube ads, sponsorships, courses, consulting?
17:37
Speaker A
Do you want to scale yourself or scale a team?
17:39
Speaker A
Is being known important or would you take impact without visibility?
17:42
Speaker A
How do you feel about corporate clients versus individual learners?
17:45
Speaker A
These will sharpen which path fits you.
17:47
Speaker A
Worked for 39 seconds.
17:48
Speaker A
Okay, before I continue.
17:50
Speaker A
I just realized now you're just indulging me.
17:53
Speaker A
In my me figuring out my future plans.
17:59
Speaker A
So if you're not interested in that, honestly, you can stop right here.
18:03
Speaker A
Because I'm just going to continue doing this.
18:05
Speaker A
For the next little bit.
18:08
Speaker A
But the point is bringing it back for having a note-taking system.
18:13
Speaker A
Right, what really continued to surprise me is how good LLMs are at taking information.
18:20
Speaker A
And being able to pull out some really great ideas.
18:25
Speaker A
And being able to identify, especially with connected notes.
18:28
Speaker A
The core notes that matter to you.
18:31
Speaker A
So what it's able to do is without me needing to review all of my notes.
18:38
Speaker A
It's able to pick out things like this.
18:40
Speaker A
So if you are working on something and you want to build on top of it, you want the ideas to compound and not just build sand castles.
18:48
Speaker A
Then you have to document it.
18:51
Speaker A
It has to be explicit.
18:53
Speaker A
So that AI can work with it.
18:55
Speaker A
And help you see the things that you as a human being have, you know, natural weaknesses.
19:00
Speaker A
Like digesting a lot of information in a short amount of time.
19:03
Speaker A
Right, so being able to engage in that and have your curiosity and your questioning mind.
19:10
Speaker A
And your judgment mind and your editorial mind come in.
19:15
Speaker A
Instead of just say, hey, you know, give me something.
19:19
Speaker A
And then now, oh, this is not like right.
19:22
Speaker A
So let me move on and have that task sit in its current state.
19:27
Speaker A
Is going to be so much more different than if you had these contexts.
19:32
Speaker A
You can go deeper.
19:34
Speaker A
So with that, I hope you enjoyed this video.
19:38
Speaker A
If you have any questions.
19:40
Speaker A
Let me know down below, I will link the Claude code setup information down there as well.
19:44
Speaker A
All right, I'll see you in the next video.
Topics:AInote-takingcontext engineeringprompt engineeringlarge language modelsLLMknowledge managementcommunicationframeworksObsidian

Get More with the Söz AI App

Transcribe recordings, audio files, and YouTube videos — with AI summaries, speaker detection, and unlimited transcriptions.

Or transcribe another YouTube video here →