HomeVideos

She Built the AI System Every Marketing Team Will Soon Need | Lucy Hoyle, Carta

Now Playing

She Built the AI System Every Marketing Team Will Soon Need | Lucy Hoyle, Carta

Transcript

1120 segments

0:00

The general theory was that the more

0:02

information you gave an LLM, the better

0:04

the [music] output would be. More

0:06

information does not equal better

0:07

information. You're actually degrading

0:09

the memory of the model. And so that's

0:11

why they call it context rot.

0:12

>> Do you monitor token usage at all or

0:16

have alerts if someone's using too many

0:17

tokens?

0:18

>> We've always been more cautious about

0:21

optimizing for efficiency. Let's not try

0:24

to token lax.

0:25

>> Lucy Hy is the senior content engineer

0:28

at Carta. the company building the

0:30

infrastructure and connectivity for

0:32

private capital. [music] In this

0:33

conversation, Lucy shares what context

0:36

rot is and [music] how giving more

0:38

context to LLMs can actually be a

0:40

negative thing. How she took an idea

0:42

that she started at Profound's marketing

0:44

engineer hackathon and turned [music] it

0:46

into a real marketing OS that her entire

0:49

team can use. And finally, how token

0:52

discipline makes AI sharper [music] and

0:54

not just cheaper. I'm Nick Laferdy.

0:57

Let's get into it. So your role has

0:59

evolved at Carta from more of a content

1:01

marketer to content engineer and now

1:04

maybe more of a marketing type engineer

1:06

at least in spirit. Can you tell me what

1:08

that transition has been like for you?

1:10

>> Kind of crazy actually. Like it feels

1:12

like it's gone at breakneck speed I

1:13

think like most people that are working

1:15

within the sort of AI space at the

1:17

moment. So I joined Carter 3 years and 3

1:21

months ago. um started as a content

1:23

marketer and yeah was basically writing

1:25

everything by hand like spending hours

1:28

researching all the topics um working

1:30

kind of very closely with our SEO team

1:31

to make sure things were optimized and

1:33

then trying to localize content as well

1:35

from the US for Europe um and it was

1:38

really really slow like like maybe like

1:40

one article every few weeks or something

1:43

and just feeling slightly overwhelmed by

1:45

the amount of work there was to do and

1:47

not being able to deliver at the pace um

1:49

at which I needed to be able to scale

1:51

the content operations in Europe. And so

1:54

when I um moved across the US team sort

1:56

of a couple of years ago, AI started

1:58

becoming more of a a thing. There were

2:00

kind of the the early days of the

2:02

content generation tools like people

2:04

were kind of starting to use chat GPT

2:06

and then I started to realize that this

2:08

was going to become more of a permanent

2:09

shift and it was actually something I

2:10

was really interested in. So um I had a

2:13

super supportive manager and CMO who

2:14

kind of backed me to to go and sort of

2:17

do the training that I needed to do to

2:18

become a bit more technical. And then of

2:20

since January this year um I got

2:22

promoted into content engineer position

2:24

which was really exciting and just like

2:26

a great validation of not only kind of

2:28

like my sort of professional development

2:31

journey but also that Carter was taking

2:33

that role really seriously. Um and so

2:35

I'm the first content engineer at Carter

2:37

which is amazing that they've kind of

2:38

created that role. And then yeah, like

2:40

literally that was what like 6 months

2:42

ago. Um, and then now my role is kind of

2:45

almost progressing from like outside of

2:46

just pure content remitt to becoming

2:49

like marketing agnostic. So I'm working

2:51

with like PMM, with events, with DG to

2:54

figure out how to like optimize existing

2:57

workflows, but more than that kind of

2:59

like see what we can do that's like

3:01

different and think in sort of new ways

3:05

about the way that we that we market to

3:07

our customers.

3:07

>> That makes sense. And shout out to Carta

3:09

for recognizing like the value in you

3:11

and your work and then how marketing and

3:14

content and marketing engineering is

3:15

kind of shifting. It's kind of becoming

3:17

more of the future of what your role and

3:19

even my my role

3:20

>> looks like too. Uh and so as part of

3:22

that transition, you're kind of working

3:25

more crossunctionally across other

3:26

teams. We talked a bit about systems

3:29

thinking as well, kind of what that

3:31

means. Can you kind of talk about what

3:32

systems thinking means to you and how it

3:34

applies to your role? Yeah, I think

3:36

fundamentally it's

3:38

stepping outside of your like dayto-day

3:41

and and outside of the silos that we all

3:43

too often work in. I mean, Carter is a

3:45

big company. It's like 1,800 people and

3:47

so like when you've got teams working on

3:49

specific things, it's very easy to

3:51

forget to make those crossunctional con

3:53

connections. Um, so when I started at

3:55

Carter, I was on a very small team. I

3:56

was part of the Europe business unit.

3:58

Um, I was yeah the only content marketer

4:01

like now I think they're a team of two

4:03

um two to three. So I had to become like

4:06

a more of a generalist very quickly. So

4:08

I was doing like long form content sort

4:11

of like gated assets, social copy

4:13

emails, just anything that touched

4:14

content. And I think that really helped

4:16

me understand like how everything fits

4:18

together. And also being able to work

4:20

across regions. So we've we've expanded

4:22

now. We're in Singapore, we're in Hong

4:23

Kong, like we're in the Middle East and

4:25

like all over America as well. So, it's

4:26

having that like international view um

4:29

but also having to get so deep into like

4:32

audience messaging and and product

4:34

positioning and stuff to be able to

4:36

write to the depth that I needed to like

4:38

gave me that that breadth and depth. So,

4:40

I became kind of T-shaped naturally. And

4:42

then when I moved across to the um US

4:45

org, I realized how siloed everything

4:48

was like because there's there's a team

4:49

for events, there's a life cycle team,

4:51

there's like a content team and so like

4:53

there wasn't one person doing

4:54

everything. And so I think because I had

4:56

the benefit of being more of a

4:57

generalist that helped me yeah take more

5:00

of a systems thinking approach like how

5:01

does everything fit together and how do

5:03

you kind of like make the connections

5:05

between the amazing work that individual

5:07

teams are doing and ensure that you're

5:10

leveraging all of the like the

5:12

information the context the the kind of

5:14

institutional knowledge that we all have

5:17

and helping us like work faster by

5:20

making those connections. Yeah, I've

5:21

talked to other marketing engineers who

5:24

kind of have two approaches to this. One

5:25

is you take your old system that you

5:28

were doing manually and then you find a

5:30

way to use AI to do it at an automated

5:32

way. Or other people who think like you

5:33

have to tear down the old system and

5:35

kind of start from scratch. Like which

5:36

of those camps are you in?

5:37

>> I think previously I was in the first

5:39

camp just because that makes the most

5:41

sense, logical sense as humans. It's the

5:43

way we've always worked. But I'm

5:44

starting to realize that that the second

5:46

option is is the way that we need to go.

5:48

and our CEO Henry, he's very forward

5:51

thinking with AI, which is fantastic and

5:53

it's really like inspiring to see

5:54

someone at the top who's kind of like um

5:56

encouraging everyone to to use AI more

5:59

in their daily work. But his his

6:01

philosophy on it is that we shouldn't be

6:03

using AI like using AI for efficiency is

6:06

is kind of table stakes now. We've

6:08

actually got to use it for leverage. So

6:09

it's instead of looking at your existing

6:11

workflows that are linear and kind of

6:13

like step by step and then using AI to

6:15

kind of like improve some of that, he

6:17

says take a step back and think about

6:19

the outcome first. Like where do you

6:21

want to get to and then almost reverse

6:22

engineer that and often using Claude as

6:25

a thought partner and helping you

6:27

understand like right this is where I

6:28

want to get to and like Claude will

6:30

often suggest things that you haven't

6:32

necessarily thought of. Um, so I think

6:34

yeah, like instead of looking at what

6:36

you're doing already and trying to do it

6:37

faster, better, like more efficiently,

6:40

like you say, tear down the whole system

6:41

and think, well, what are we not doing

6:43

now that we could be doing? So it's like

6:44

this kind of like blue sky thinking

6:46

almost.

6:47

>> That's a lot of how I use Claude, too,

6:48

of I one of my most used skill is a

6:50

skill that pokes holes in my LinkedIn

6:52

posts to find like find arguments like

6:54

what am I missing like what what gaps do

6:56

I have? What's the obvious as a thought

6:59

partner? Like you said,

7:00

>> you also told me that you helped with

7:02

the roll out of Claude across your whole

7:04

company. Can you tell me what that was

7:05

like?

7:05

>> It was so exciting, but also like

7:07

chaotic in the best way. Um, so yeah, it

7:11

was we started in March um of this year

7:13

and the goal was basically to get 1,800

7:16

people across Carter using Claude chat,

7:18

co-work, and code within like a 3 to six

7:22

week period. Um, and so when I first got

7:25

wind of it, I was kind of put into this

7:26

early adopters group. Um and it was a

7:28

mix of sort of tech leads and business

7:30

champions that have been selected from

7:32

from across Carter. So I was

7:33

representing marketing with um three

7:36

other people and we did a bit of a crash

7:39

course in like sort of learning to use

7:41

the the different interfaces of Claude

7:44

and then what we learned from those kind

7:46

of like almost like guinea pig sessions

7:48

was then put into the broader curriculum

7:51

that we then rolled out to,800 people

7:53

across Carter. And so like it was very

7:55

much like learn on the spot like build

7:58

as you're flying the plane. Love that

8:00

analogy. Um and it was it was a lot of

8:03

fun. Um I think we learned a ton. Um and

8:05

like my key takeaway was that these kind

8:08

of like trainings have to be adapted to

8:11

the level of the audience that you're

8:13

speaking to. And so we had some people

8:14

that had already started using Claude um

8:17

through a CLI rather than like through

8:19

the desktop app. So they were like miles

8:20

ahead. And so the sessions we had with

8:23

them were far more kind of like

8:24

practical and like almost like you say

8:26

poking holes in things and and really

8:28

pushing the boundaries of what we could

8:29

do. And then you had some people that

8:30

had never touched Claude. And so that

8:32

was very much foundational getting them

8:33

to understand how skills worked um like

8:36

how to prompt effectively. [snorts] Um

8:38

and I think the best learning from that

8:40

is like how do we then apply that to the

8:42

way that we talk to our customers.

8:43

Carter operates in a very regulated

8:44

industry and and we serve customers from

8:46

all the way from like startup founders

8:48

to to LPs, investors. Um, and we see

8:51

like a broad diversity in how um, our

8:53

customers have been like taking to to

8:56

AI. Um, I think on the venture capital

8:58

side, they're very kind of forward

9:00

thinking, very like risk, they're not as

9:01

riskaverse. Um, and then on the private

9:03

equity side, they're a bit more

9:04

traditional. And so, I think like

9:06

figuring out like the importance of

9:08

tailoring your training to the audience

9:11

you're speaking to internally has helped

9:13

when we've been rolling out like the

9:14

claw plugins and our CLI to customers as

9:17

well.

9:17

>> Nice. Um, do you monitor token usage at

9:21

all or have alerts if someone's using

9:23

too many tokens?

9:24

>> Yeah, I think we do now. I know a lot of

9:25

companies like initially they went down

9:27

the route of having these like

9:28

leadership like dashboards and like

9:30

who's using the most tokens and stuff

9:31

whereas I think we've always been more

9:34

cautious about like optimizing for like

9:37

efficiency. I don't see that it's like

9:39

necessarily dampened experimentation.

9:41

And I see that it's actually helped us

9:43

learn how to aid prompt effectively, but

9:46

also be like be really careful with what

9:48

we're building and not just kind of try

9:50

and apply AI to everything. Like think

9:52

critically like okay like do I need to

9:53

use AI for this? Like is it going to

9:55

give me a better result? Um and then

9:58

starting to think about okay well like

10:00

if you're using an LLM for the logic of

10:03

something can you use something like a

10:05

Python script where you've got a more

10:07

repeatable process that doesn't need

10:09

that logic layer applied. So I think

10:11

yeah taking a step back and being like

10:13

okay let's not try to token max has

10:15

[snorts] been probably more useful for

10:17

us understanding how to really work with

10:19

AI. Um and I think yeah initially like

10:22

we had in the claw desktop app in your

10:25

settings you can see like how much

10:27

you've used and so we would have like

10:28

monthly caps and I think the engineers

10:30

kind of had unlimited use obviously but

10:32

now they've they've increased it but set

10:34

like slack alerts if you're use if

10:36

you're kind of spiking. Um, so it's

10:38

yeah, it's I it hasn't felt like

10:41

monitored. It's more just like

10:42

empowering us to make conscious

10:45

decisions about the way that we're using

10:46

Claude and when we're using it.

10:48

>> That makes a lot of sense. And I think

10:49

the Slack alert is smart, too. Like you

10:51

don't want to encourage people to just

10:52

burn a bunch of tokens on things. And

10:54

even finding a way of like when do you

10:56

use AI and then when do you don't also

10:58

seems like a really kind of smart

11:00

approach, too, where I see people using

11:02

AI for everything. And I don't it feels

11:04

very kind of like you have one tool and

11:05

it's a hammer and you just like swing it

11:07

at every problem. That's not necessarily

11:08

the right way to build a nail.

11:10

>> Yeah. Exactly. Exactly. Okay. So a few

11:12

weeks ago you uh participated in

11:15

profounds hackathon. Can you talk about

11:16

what that process was like and then a

11:18

bit about what you built there too?

11:20

>> It was awesome. Um completely

11:22

exhausting. Like I think the the next

11:24

day I slept for like six eight hours cuz

11:26

my brain was just exploded. But yeah, so

11:29

I think the the question that we kind of

11:31

had to work towards was like take a like

11:36

a process um that is inhuman in scale or

11:40

scope and use AI to basically attack

11:44

that problem. Um and so like the

11:47

diversity of what people built that day

11:49

was so cool to see. Um I mean like we

11:52

were standing at the back when people

11:54

were presenting we're going this is so

11:55

cool like how does that work? And it was

11:57

just great. The energy in the room of

11:58

like people kind of going around and

11:59

seeing what other people were building

12:01

and like people flew in from all over

12:02

the world, right? Like it was crazy for

12:05

me. The experience was was useful

12:08

because of those connections, but also

12:10

it showed me like what I can actually

12:12

achieve if I kind of time box stuff and

12:14

I have like a set amount of time to try

12:17

and get from like an idea to MVP to

12:21

something that's good enough that I can

12:22

present it but not perfect. And I think

12:24

that's something that I've struggled

12:25

with and a lot of people that when we

12:27

were doing like the clawude roll out at

12:28

Carter and and various hackathons we've

12:30

done internally, people try to almost

12:32

like boil the ocean and do too much

12:35

because AI gives you the ability to

12:36

pretty much do anything. And so it's

12:38

like where do you start but where do you

12:40

stop? Um and so I kind of got partway

12:43

through the hackathon. I remember you

12:44

coming over to me and saying like how

12:46

you getting on and I just looked at you

12:47

like no [laughter]

12:48

I can't do it. And at that moment I I

12:51

decided to just like pause and be like,

12:53

"Okay, I can't do everything today and I

12:56

only need to do a few things to get like

12:58

a working model." And so I then honed in

13:01

on a very specific use case like instead

13:04

of kind of Yeah. uploading a ton of

13:05

information. I I handpicked and just

13:08

built something that I could actually

13:10

test against and it worked and that was

13:12

all I needed.

13:13

>> Cool. Okay. So tell tell us about what

13:15

you built.

13:16

>> Um so it was essentially like a

13:18

marketing brain. The premise of it was

13:19

that issues that we've been seeing pop

13:22

up at Carter since we started the claw

13:24

roll out is that everyone got super

13:25

excited and started building skills

13:27

plugins like left, right, and center.

13:29

And we didn't really have a a sort of

13:31

like consolidated way of sharing those

13:34

and making sure that they were kind of

13:35

all built according to best practices.

13:37

And so we've been [snorts] using like a

13:39

shared Google drive, but then you have

13:41

version control issues where like you

13:42

have to kind of download the skill from

13:44

the Google Drive, install it into your

13:46

own cloud instance, and then if someone

13:47

updates it, you've got to update it

13:48

again. And also we were seeing like the

13:51

context that the skills that Claude uses

13:54

to when it runs a skill was almost

13:56

hardcoded. So it was living in the sort

13:58

of the skill.md file and [snorts] then

14:00

that obviously causes version control

14:02

issues and everyone's kind of pulling in

14:05

their own context like if if context

14:07

changes you've got to re-upload that and

14:09

so there was no single source of truth

14:11

across the skills that we were building

14:13

in marketing and so something that I

14:16

wanted to do was to see if we could like

14:18

build like a sort of shared context

14:20

layer um which I termed the marketing

14:22

brain and then build like skills and and

14:26

scripts that could reference that

14:27

context layer and yeah I managed it

14:29

which is super exciting.

14:30

>> That's brilliant. And so you how much of

14:32

that did you get done on the day and

14:34

then I guess what have you done with it

14:35

since then?

14:36

>> So I got like a a very c kind kind of

14:38

small subsection working on the day. So

14:41

I built I used plan mode in code to kind

14:43

of map out the whole thing. Um and then

14:46

made a a few tweaks as I went. Um but

14:48

that kind of ensured that I was like

14:49

following a a consistent track and and

14:51

didn't get completely distracted by

14:53

trying to do other things. I use

14:54

profounds agents to generate like

14:58

product um messaging documents. So the

15:00

use case I picked was we had to pretend

15:03

that we were working for OpenAI and a

15:05

lot of the AEO data we had was on like

15:08

chat GPT compared to like Claude,

15:10

Perplexity, other kind of LLM tools. And

15:12

so I said, okay, I'm going to try and

15:15

kind of build a competitor takedown

15:17

campaign putting chat GPT against Claude

15:19

and Perplexity. Um and so that was yeah,

15:22

my super narrow use case. Um and so I

15:24

pulled some um AEO my AI visibility data

15:27

from from profound um connected profound

15:29

to my cord instance via API um and then

15:32

was basically able to pull in all the

15:34

data that was showing up in my

15:35

dashboard. And so that was my first kind

15:37

of like bit of the marketing brain that

15:39

data that was coming in from profound

15:41

and then I then used those insights to

15:44

build like product messaging documents

15:45

for chat GBT. And it was it was amazing.

15:47

Like the agent I built was able to yeah

15:50

like like search the web, pull in like

15:52

all of the sort of competitor intel from

15:54

profound. Um and then I gave it a

15:56

template and it mapped um the

15:58

information it had pulled to the

15:59

template that I wanted it presented in.

16:01

That obviously then went up to the

16:03

marketing brain and I built out a git

16:05

repo to store this kind of context layer

16:08

um because I wanted it somewhere that

16:10

would be able to be updated and shared

16:12

with other people and somewhere that was

16:14

kind of like safe as well. So we have

16:16

like an internal Carter um git repo that

16:18

we're going to start rolling out in a

16:19

couple of weeks as well. And so those

16:21

context files lived in there. Um and

16:24

then I as I say used claw code to plan

16:26

and build the whole thing. Um and I

16:30

once that context layer was was started

16:33

to be built out, I built a like a data

16:35

filter. Um and we've we've talked about

16:38

this quite a lot like the the importance

16:39

of kind of avoiding context rot. Um, so

16:42

in order to stop Claude pulling all of

16:44

the information down um, in one go and

16:46

kind of like hitting the context window

16:48

immediately, I realized that I needed to

16:50

build in like a bit of a buffer so that

16:52

it could kind of like filter the

16:53

information it was pulling down.

16:55

>> Okay. Well, I want to talk about that in

16:56

a second. And the git repo, we'll come

16:58

back to um, the agent you built for

17:01

this. I think we'll be able to put that

17:03

in our agent marketplace that that we

17:05

just launched. And so if that sounds

17:07

interesting to anyone, like that'll be

17:08

available. We'll try and link it in the

17:10

show notes below. Okay. So, talk to me

17:12

about context rot and kind of how you

17:14

kind of worked around that problem.

17:16

>> Yeah. So, it's something that I wasn't

17:18

really aware of until as part of our

17:20

cord roll out. Um, we've been doing

17:22

these like learning labs like AI

17:23

learning labs and one of the ones that

17:25

one of our European engineers ran, he

17:27

was talking about context raw and I

17:29

think everyone came away from that being

17:30

like, "Oh my god, we've been doing

17:31

everything wrong." Like the when people

17:34

started prompting and chat GBT like a

17:36

year ago or whatever. Um, I think the

17:39

the general theory was that the more

17:41

information you gave an LLM, the better

17:44

the output would be because it would be

17:46

more specific. Since then, I think we've

17:48

learned that like more information does

17:50

not equal better information. So, it's

17:52

like you have to be more specific and

17:54

more targeted with what you tell an LLM.

17:57

So, the premise of context raw is that

17:59

every time you provide information to an

18:01

LLM, it will basically load all of that

18:04

information plus its own like memory.

18:06

And so you you get to a point where you

18:08

see the little like wheel in the bottom

18:10

right hand corner of a claude session

18:12

and [snorts] every time it kind of like

18:13

hits its max, it'll almost like stop the

18:17

conversation and then try and condense

18:18

it and and start again. And so every

18:20

time that happens, you're actually

18:22

degrading the memory of the model. And

18:24

so that's what why they call it context

18:26

rot. And so the flip side of that or the

18:28

solution to that is context engineering.

18:30

And this term engineering obviously

18:32

keeps coming up left, right, and center.

18:34

But it's the idea that like similar to

18:35

prompt engineering where you have to be

18:37

yeah very careful and very critical with

18:39

the way that you prompt the same applies

18:42

to the context. So it's like what am I

18:43

giving Claude and like can I give it

18:46

information in bits so that it's able to

18:49

kind of like chunk the information. Um

18:51

so I think that's called progressive

18:53

disclosure.

18:53

>> Okay. And so is you were able to build

18:55

that within the marketing brain that you

18:57

you were building at the hackathon.

18:59

>> Yes. So that was the purpose of the data

19:00

filter. Um, so I knew that like if I had

19:04

this kind of context layer living in

19:06

Git, I could put so much in there and if

19:08

Claude was trying to access all of that

19:10

information every time I ran a skill, it

19:11

was just going to max out the content

19:13

context window straight away. And so I

19:15

thought, I've got to build in some sort

19:17

of buffer. And so I used I did a bit of

19:19

research on Python scripts. Um, and I

19:20

found one called like an open- source

19:22

Python library called BM25, which is

19:25

actually used in elastic search, which

19:27

was seemed perfect for what I wanted to

19:29

do. So essentially when someone runs a

19:31

skill or or sort of starts a

19:33

conversation in Claude um Claude will

19:35

kind of like analyze the prompt and then

19:37

pick out key words from that. It will

19:39

send it up through the BM25 script.

19:41

Those that Python script will match the

19:44

keywords to context that lives in the

19:46

marketing brain and then it will pull

19:47

down the relevant chunks of information.

19:49

So Claude is only using the context that

19:52

it needs for that specific use case.

19:54

>> That's really smart. Yeah. And we'll

19:56

we'll find that and we'll put that in

19:57

the show notes too because it's open

19:59

source an open source Python script

20:00

basically.

20:01

>> Yeah. Yeah. And it was super easy to

20:02

use. I thought I was going to have to

20:04

like do loads of implementation but I

20:06

mentioned it when I was using plan mode

20:07

include code and then it and I gave it

20:10

the um like the the correct links to

20:13

kind of go and find the information

20:14

online and it it basically found

20:15

developer docs and stuff and and

20:17

installed it on my Mac. So yeah, it runs

20:20

like a dream.

20:21

>> It's so good.

20:22

Um, okay. So, I I want to come back to

20:24

kind of like the broader reason you you

20:26

built this and kind of what's happened

20:28

since then. So, you had this idea, you

20:30

started it at the profound hackathon

20:32

>> and then I like what happened after that

20:34

like you went back to work and how are

20:36

you implementing what you started there

20:37

in your day job?

20:39

>> Yeah, so um I can't take full credit for

20:41

for the idea. It's actually been kind of

20:43

the result of a few conversations I've

20:46

been having um at work when we started

20:48

the the crawled roller. I think we got

20:49

to the point where the skill sharing was

20:52

becoming an issue, but we were also

20:53

realizing that like the context, the

20:55

information was just like we needed to

20:57

find a way of actually better

21:00

controlling um what was going what we

21:03

were feeding Claude and making sure that

21:04

everyone was kind of speaking from the

21:06

same source of truth. And so we had an

21:10

amazing offsite in Nashville for the

21:12

whole marketing team at the end of May.

21:14

and um our like revenue team um and our

21:18

like digital marketing team, a few of

21:19

them presented on their idea of like the

21:22

the context layer um and then how it

21:24

would fit into um like a decision or

21:27

execution layer and like our data core

21:29

and so the the thinking was there um and

21:32

then I kind of took that took it brought

21:35

it to the hackathon wanted to see if I

21:37

could create like a working version of

21:38

it and since then I had a couple of

21:40

colleagues fly in from SF last week and

21:42

we literally locked ourselves elves in a

21:44

meeting room for like 2 to 3 days and we

21:46

were like let's just hash this out and

21:48

it went from us all having slightly

21:51

different ideas of how this would work

21:53

to a really consolidated what we're

21:56

calling the marketing operating systems

21:57

the marketing OS for Carter and like a

22:00

clear plan to implement it and we

22:01

presented that marketing all hands on

22:03

Wednesday and it went down really well

22:05

so I'm so excited to actually like start

22:07

making this happen

22:08

>> that's so cool and so is there a

22:09

timeline for when you'll work on it and

22:11

it'll be done or the first version Yeah,

22:13

I think we we want to try and move

22:15

quickly with it, but we're also aware

22:17

that again there's two approaches.

22:19

Either you take it like step by step and

22:21

you think, okay, let's let's do it on a

22:22

campaign by campaign basis. So, one of

22:25

our offerings at Carter is QPS. It's a

22:27

sort of like tax efficient um system for

22:30

for equity. And we were like, okay, do

22:32

we start with that as a very small use

22:34

case? Do we get all of the information

22:36

from across Carter that relates to that

22:38

like QPS and then do we kind of build on

22:40

that or do we go the other way and we

22:42

try and get all of the teams across

22:44

marketing to collect all of their data

22:46

and then we upload it all at once and

22:48

then we might get to this point where we

22:50

kind of don't know what's worked, what

22:51

hasn't worked. So I think we're like

22:53

still teasing out like how that's like

22:56

the way that we're going to approach it.

22:57

But we've got meetings booked in like

23:00

discovery meetings with specific teams.

23:02

So we had the brand team last week.

23:03

We've got um DG team today and we're

23:06

basically like meeting with them to try

23:07

and understand like what types of

23:09

information they use in their daily work

23:11

but also what types of information they

23:13

produce. So like if demand genen run a

23:15

campaign, what is the data that they get

23:18

from that that could be useful for other

23:19

teams? And so yeah, we're kind of

23:21

mapping that out. At the same time,

23:22

we're doing the skill curation work. um

23:25

we've decided on a committee um that's

23:28

basically going to look at all of the

23:30

skills that people have built across

23:31

marketing and decide if they can be made

23:33

more crossunctional and then if they

23:36

kind of pass that committee stage

23:38

they'll get uploaded into the git and so

23:40

everyone can access them. So it's yeah

23:43

it's [laughter]

23:44

trying not to boil the ocean and trying

23:46

to do it methodically while also moving

23:48

very quickly and like biasing to action

23:50

is a real challenge. Um, but I think

23:52

like now that we've made inroads and and

23:54

like we're communicating regularly with

23:56

our CMO Nicole and obviously using a lot

23:58

of Henry's philosophy to to make sure

24:00

we're on track and and getting feedback

24:02

at every stage from different people

24:03

across marketing. Um, and then when we

24:06

presented it like I think we've got the

24:08

excitement going. So like it's yeah, we

24:10

just got to keep that ball rolling.

24:11

Yeah, I think I think maybe every head

24:13

of marketing watching this is probably

24:14

fascinated with what you're building

24:16

because it seems like the dream like a

24:17

true marketing OS with shared context

24:19

across different teams and skills, what

24:21

everyone's doing, take the outputs and

24:24

kind of have a more centralized place

24:25

where everything just kind of lives and

24:28

uh is is truly centralized uh which I

24:30

think is really really amazing. We'll

24:31

have to have you back in Yeah, I'm sure

24:33

I'm sure it'll work. We'll have to have

24:34

you back in a bit to to get out there on

24:37

how it's been and the roll out and all

24:38

that stuff. is part of that you've kind

24:40

of had to learn Git as well. Uh what has

24:43

that process been like for you?

24:44

>> Yeah, so I I feel like I probably

24:46

haven't gone as deep on it as I as I

24:49

could have. And

24:51

part of the reason for that is that like

24:53

I'm trying not to overwhelm my brain

24:55

with all of the things that I could

24:57

learn. And maybe I'm a little bit late

24:59

to the the party with with Git. Like

25:01

obviously you've been using it for like

25:02

what 10 years or something. Um and I was

25:05

never that technical. So, I think the

25:08

getting to grits with with Claude and

25:10

everything has kind of shown me that

25:11

like I need to know enough to like get

25:13

by and to teach other people without

25:15

trying to go like too deep on everything

25:16

because I will just get overwhelmed. So,

25:19

we're really lucky that we've got like

25:20

an amazing engineering team at Carter

25:22

and some of them are tasked with

25:23

building out like internal

25:24

infrastructure and so they've set up

25:26

like they were exploring various options

25:28

for for the skill sharing. As I say, we

25:30

started with Google Drive. That wasn't

25:32

really working. And so now they've

25:33

decided Git is the best place for us to

25:35

store that, but we were hitting an issue

25:37

where we ran out of licenses for for

25:39

GitHub. And so they've built like an

25:41

internal Git server, which is fantastic

25:43

cuz it's kind of secure. You haven't got

25:45

people creating their own like personal

25:46

Git accounts and sharing company

25:48

information. And so I think yeah, as I

25:49

say, we'll be rolling that out properly

25:51

in a couple of weeks. Um, and I think

25:53

they've created like a TLI command um

25:55

that you can literally just like yeah

25:57

use within within CL code um and give it

26:00

the um SSH to your specific git repo

26:04

[snorts]

26:04

and then yeah you you create this

26:06

amazing feedback loop where crawl is

26:08

able to pull information from the git

26:10

repo but also pass it back up and I

26:12

think that's another key aspect of the

26:14

marketing OS is that those learnings we

26:17

get from every time we run a skill or

26:18

run a campaign through claude like it

26:20

will ask the user user if they want to

26:23

kind of commit that information back up

26:24

to the marketing brain or the context

26:27

layer. And so it's like a the system

26:29

learns from itself which is really

26:31

fascinating.

26:32

>> Yeah, I think that's the way to go too

26:34

is I think when you learn git all you

26:36

really need to know is the like what it

26:38

does like you can like push and pull and

26:41

what a pull request is like once you

26:42

know the right terms you can tell claude

26:44

and then claude can kind of do

26:45

everything else for you. I have it pulls

26:48

me

26:50

GitHub is smart enough to where it'll

26:52

tie your GitHub username and Claude to

26:55

it. So

26:57

directly for you to the repo which is

26:59

really cool.

26:59

>> Yeah, it's super exciting and and also

27:01

like one [laughter] of the the things we

27:04

say most often at Carter and we should

27:05

probably create a swearbox for it is

27:06

like have you asked Claude? Like if

27:08

anyone has questions, technical

27:10

questions like that, the first place you

27:12

should go is is Claude because it can

27:14

obviously scrape the web. there's just a

27:15

wealth of information that it can kind

27:17

of consolidate and um if you say like

27:20

explain this to me like I'm five then

27:22

you get a really kind of logical

27:24

non-technical answer. Um and so yeah, if

27:27

you're not sure how to use Git or how it

27:29

works like Claude is the best place to

27:30

start.

27:30

>> Yeah. Um that was actually my next

27:32

question for you is how do you stay

27:34

current? How do you learn and stay up to

27:36

date on all everything AI? partly like

27:38

LinkedIn is really powerful for this and

27:40

I think once you start making

27:42

connections then that like information

27:44

starts being woven through comes up in

27:46

your timeline like I get most of my

27:48

information from LinkedIn I think and

27:49

then I pass it on to my colleagues and

27:51

they do the same so it's this really

27:52

nice like living breathing channel and

27:55

then like inerson events I think since I

27:57

moved to New York 2 3 months ago um I've

28:01

been like overwhelmed by the amount

28:03

that's going on in this space um and I

28:05

think like getting to know you has been

28:06

really helpful cuz you'll invite me to

28:07

events I'll kind of like invite you to

28:10

stuff. And then yeah, just just meeting

28:11

people that are doing [clears throat]

28:12

the same thing but also having the same

28:14

struggles. Um, and I think what's so

28:16

nice about this community, whether it's

28:18

like the SEO, AEO community or marketing

28:20

engineering, whatever you want to call

28:22

it, is that people are like so willing

28:24

to share their knowledge. And like I

28:26

don't know if you found the same, like

28:29

>> it's yeah, it's just such a it feels

28:31

like a safe space. Um, and the stakes

28:34

are pretty low just because

28:37

I think with SEO it felt often quite

28:39

intimidating cuz you'd had people that

28:40

have been in the industry for like 10,

28:42

20 years and you're like, how do I ever

28:43

get to that point as someone who's kind

28:45

of like fairly fresh in my career

28:47

whereas now like we're all starting from

28:49

the same point and everyone's bringing a

28:51

different perspective. Um, and it just

28:53

feels like a like it feels like the

28:55

center of gravity at the moment.

28:56

>> It does. Yeah. And there's there's so

28:58

few people who are doing this right

29:00

right now. so few people who are current

29:02

marketing engineers or want to become.

29:04

And that that number is definitely

29:05

growing, but there's maybe one or two at

29:07

every company right now. And so if you

29:09

want to learn, you have to look outside

29:11

and find other places. And some of the

29:13

meetups that you and I have been to have

29:14

been really helpful because you learn

29:16

that everyone's kind of attacking the

29:18

same problem at the same time. Like

29:20

we're all stuck on this thing or finding

29:22

the right context layer or context raw.

29:23

And it's really validating to get to

29:25

that point and say, "Oh, like we're all

29:26

in the same position right now."

29:28

>> Yeah, 100%. and and hearing from like

29:30

leading companies that are that are

29:32

having the same problems. We were at the

29:33

multi-engineer um meetup that was I

29:36

think put on by um work OS and NOG um

29:39

last week and hearing from people at

29:42

RAMP versel um cursor they're having

29:46

similar issues in terms of like

29:48

skillsharing and and trying to

29:51

implement more conformity like while

29:54

rolling out AI to to a sort of fairly

29:56

big company and then also the way that

29:58

they're thinking about solving that and

29:59

and the the progression that they've

30:01

been on. So I think um one of the knock

30:04

um team was saying that they'd started

30:07

with like the idea of sessions. So kind

30:09

of working in like chat conversations

30:11

sort of like isolated tasks and then

30:15

moving on to projects. Obviously, a lot

30:17

of this is very like clawed terminology.

30:19

Um, but thinking, well, how do I work

30:22

within like a shared area of context and

30:25

kind of like build conversations on top

30:27

of each other and then moving from that

30:29

to systems and I think seeing that

30:31

mapped out on a slide and I looked at my

30:33

my colleague from Carter and I was like,

30:35

yeah, this is what we're trying to do as

30:36

well. It's that idea of the system that

30:38

that everyone's working towards.

30:39

>> Amazing. Yeah. And I think if you're

30:41

interested in attending more local

30:43

meetups that profound will have some

30:44

exciting updates to to share there

30:46

pretty soon. So amazing.

30:47

>> Okay. So I guess last question if you're

30:50

someone watching this and they're like

30:52

wow Lucy how you moved from content

30:54

marketer content engineer like I want to

30:56

go do something like that too. What

30:58

advice would you give those people?

31:00

>> There's no better time to be doing

31:01

something like this. It's obviously a

31:03

really like thriving space and so like

31:06

now is a great time to consider like a

31:08

career transition whether you kind of

31:10

want to move externally or or maybe

31:11

bring it to to your manager and say like

31:13

this is this is something I'm really

31:15

interested in. I think proving the value

31:17

of it is often where people get stuck

31:19

and so like speaking to to companies

31:21

like profound or um Carter ramp where

31:24

they've um started like doing this

31:26

internally and and trying to figure out

31:28

how they got exact buy in. Um, that's

31:30

like the crucial thing. And then once

31:32

you've kind of been proactive yourself

31:34

and pushed it from the bottom up and

31:36

then you've got that leadership buy in,

31:38

it's so much easier to to kind of like

31:40

go full steam ahead.

31:41

>> I I totally agree. Someone asked me a

31:43

similar question at our zero click

31:45

conference in New York last week. And I

31:47

think my answer to them was something

31:49

around take something you're doing right

31:52

now and just use build AI around it. And

31:55

>> so take like kind of like the V1

31:56

approach that we talked about earlier of

31:57

just like take a current process and

31:59

just find a way to do it with AI and

32:01

then find a way to talk about that when

32:02

you're in an interview or when you go

32:05

talk to your boss or your manager

32:06

afterwards. And then the more you can

32:08

show your work, I think the more easier

32:10

it is to get buyin for ultimately if

32:13

it's a title change, career promotion,

32:15

whatever. But like build something and

32:17

then talk about it whether it's

32:19

internally or on LinkedIn or Twitter. I

32:21

think that's generally the secret to

32:23

things is like build cool stuff and then

32:24

talk about it.

32:25

>> Yeah. And I think like the talking about

32:27

it is probably more important than the

32:29

building. And again coming back to this

32:31

idea of like presenting to your audience

32:33

like think about who you're trying to

32:35

show this to because you've gone really

32:38

probably quite deep and technical and

32:39

you're really excited about this thing

32:41

you've built. But then when you take it

32:42

to your manager or an exec, you need to

32:44

think like I need to the way that I show

32:47

this to them. I need to start with

32:49

impact and the why before I go into

32:52

loads of detail about how it works cuz

32:54

they're probably likely going to be

32:56

interested in the first two. And then if

32:57

they're like really technical

32:59

themselves, they might ask you questions

33:00

about how you built it. But I think the

33:03

the kind of instincts that when we're

33:05

like really excited about something to

33:06

be like, "Oh my god, this thing's really

33:07

cool." And then they're like, "Okay,

33:08

take a step back. Like, why does this

33:10

matter to me?" I think that's that's the

33:12

key thing that I've learned like a lot

33:14

over the past few months like kind of

33:16

presenting to to more senior people um

33:19

about what I built is like what's the

33:20

narrative what's the takeaway for them

33:22

um yeah and I think like once you've got

33:25

that kind of like relationship with an

33:27

exec and they kind of see that you're

33:28

someone who's proactive and and wants to

33:30

build um you can kind of go from there.

33:32

>> Yeah. Like I think your CMO doesn't care

33:34

about BM25 but they care about the why.

33:37

Like why are you doing this in the first

33:38

place? What time savings will you get?

33:40

how it will impact the whole org, the

33:42

whole like bottom line upfront thing and

33:44

how you talk to execs I think is one of

33:46

the best skills that marketers can learn

33:48

and no one really teaches you this

33:49

unless you have a great manager who kind

33:51

of coaches you you through it. A lot of

33:54

your experience kind of learned that way

33:55

too of just trying and figuring things

33:57

out with them.

33:58

>> Yeah. Yeah. 100%. And like as they say

34:00

like if they want more detail they'll

34:01

ask for it. And so Nicole, our CMO,

34:04

she's she's amazing because she

34:05

obviously has to have this like really

34:07

kind of like broad like agnostic view of

34:09

of what's going on in marketing and and

34:11

map that to to the rest of the company,

34:13

but she is also able to kind of go quite

34:15

deep on the detail when she wants to.

34:17

And so when we were presenting our

34:19

marketing OS idea to to her and to the

34:21

rest of the marketing team, we went

34:23

quite high level. And then like she sort

34:26

of said to us on the side like I I am

34:28

interested in like how you're building

34:29

this and the technical details. So I

34:30

said to her, do you want me to send you

34:31

like a demo of of what I built with

34:33

Aquafon? She was like 100%. But it's

34:35

like don't start with that. Like let

34:37

them almost kind of come to you and be

34:38

like, oh no, I am interested in this.

34:40

And once they've kind of got the the

34:41

highle view, then they can start digging

34:44

in, which is really powerful, I think.

34:46

>> Do you have any tips for someone who

34:48

wants to improve how they talk to

34:50

executives? Yeah, I think um aside from

34:54

really

34:56

reframing your language and and almost

34:59

treating them as like a totally separate

35:00

audience to how you talk to your team or

35:02

how you would talk to like the rest of

35:04

marketing or the rest of the company.

35:05

Think about like what they care about.

35:07

And so it's it is difficult nowadays to

35:12

kind of find data to support something,

35:14

especially where we've seen like a

35:15

massive drop off in like organic traffic

35:17

and click-through rate. Um, and so it

35:20

can be quite hard to find data to kind

35:22

of support the the argument you're

35:24

trying to make, especially if you

35:25

haven't actually built anything yet.

35:27

It's like how do you get data about

35:28

something that doesn't exist yet? And so

35:30

quite a useful strategy is to think,

35:32

well, what is the cost of inaction? Like

35:34

what are we losing by not doing this

35:36

thing? And then you can get data from

35:38

like other companies and and then like

35:40

apply that to to your own company. Um

35:43

and I think yeah something I heard at a

35:45

conference sometime last year was um

35:48

taking search data or um kind of like

35:50

revenue data from like a comparable

35:53

company if you can find even if they're

35:54

a public company um and then applying

35:56

that to your company size like the

35:58

industry that you work in and then

36:00

almost like using not dummy data but

36:02

kind of like comparable data to show

36:04

your exacts okay this is what this

36:06

company did this is what they gained

36:07

from it like this is what we're losing

36:09

by not doing the same thing. Um, that's

36:11

quite a useful strategy because I think

36:13

that like operating on fear isn't the

36:15

best principle, but it's that like yeah,

36:17

the cost of inaction, do it or die kind

36:20

of thing.

36:20

>> Yeah, I've had that same conversation

36:22

with companies about writing comparative

36:25

articles like us versus our competitor

36:27

content. And I've been able to show like

36:30

if you don't write this and your

36:32

competitor does, guess what will get

36:34

picked up or cited in LLMs? It's their

36:36

POV, their perspective on how they're

36:38

better than you. And so the cost of not

36:40

doing that is you let them control the

36:42

narrative.

36:42

>> Yeah. They get there first.

36:44

>> Yeah.

36:44

>> So powerful.

36:45

>> Great. Well, Lucy, this was brilliant.

36:47

Thank you so much for coming on. This

36:49

was an honor. Thank you again.

36:50

>> Thank you for having me.

36:51

>> Of course. That was Lucy Hy, senior

36:53

content engineer at Carta. We'll take

36:56

everything that she discussed, including

36:58

agents, workflows, and put them in the

37:00

description for you to download and take

37:02

away. We'll also put a link to her

37:04

LinkedIn profile so you can give her a

37:06

follow and learn from everything she

37:08

posts [music] online. You can also go

37:10

visit tryp profofound.com where you can

37:12

read our manifesto on the marketing

37:14

engineer and get resources for how to

37:16

become more fluent in AI in your job.

37:19

I'm Nick Laughy. Keep building.

Interactive Summary

This video features a discussion with Lucy Hy, a Senior Content Engineer at Carta, about her professional evolution from content marketing to marketing engineering. She explores the concept of 'context rot' in LLMs, where excessive or poorly structured information degrades model performance, and explains the need for 'context engineering'—specifically, using progressive disclosure and targeted retrieval techniques to provide only the relevant information to the AI. Lucy also shares how she developed a 'marketing brain'—a centralized, Git-based context layer—to improve consistency and efficiency across her team's AI workflows. The conversation highlights the importance of strategic AI adoption, effective cross-functional communication, and the value of building, testing, and sharing practical AI solutions rather than just pursuing theoretical efficiency.

Suggested questions

3 ready-made prompts