What does it take to create an effective clinical development plan? How do our early decisions shape the path of a compound through clinical phases? And how can statisticians actively balance the demands of science, speed, and cost in drug development?
In this special 400th episode of The Effective Statistician, I dive into these questions with Carrie Li, a biostatistics expert whose career spans both big pharma and startups. Carrie shares how she builds clinical development plans from scratch, collaborates with cross-functional teams, and uses statistical expertise to create strategies that drive both scientific and commercial success.
Join us as we explore the impact statisticians have on the clinical development journey.
Key points:
- Clinical Development Plan (CDP): strategy for compound progression
- Early Decisions: impact on clinical phases, timeline, cost
- Statistical Role: balancing science, speed, and cost
- Target Product Profile (TPP): guides CDP objectives
- Cross-functional Collaboration: clinical, commercial, regulatory teams
- Big Pharma vs. Startups: differences in resources, risk, investor expectations
- Adaptive Design: flexibility in clinical phases, risk management
- Regulatory Engagement: early involvement of FDA, EMA for approvals
- Competitor Landscape: use of competitive intelligence for CDP design
- Cost & Timeline Estimation: sample size, Gantt chart for budgeting
Together, we explore how to balance scientific rigor with business goals, collaborate across teams, and navigate the regulatory landscape to bring new therapies to life. Carrie shares practical advice and insights that can help anyone involved in drug development make a real impact.
Don’t miss this conversation—listen to the full episode, and if you find it valuable, share it with friends and colleagues who are passionate about advancing healthcare.
Transform Your Career at The Effective Statistician Conference 2024!
- Exceptional Speakers: Insights from leaders in statistics.
- Networking: Connect with peers and experts.
- Interactive Workshops: Hands-on learning experiences with Q&A.
- Free Access: Selected presentations and networking.
- All Access Pass: Comprehensive experience with recordings and workshops.
Never miss an episode!
Join thousends of your peers and subscribe to get our latest updates by email!
Get the
Learn on demand
Click on the button to see our Teachble Inc. cources.
Featured courses
Click on the button to see our Teachble Inc. cources.
Carrie Li
Seasoned Biostatistics Expert in Clinical Development
Lorem ipsum
Transcript
Clinical Development Plans
Alexander: [00:00:00] Welcome to another episode of the Effective Statistician and today we’ll talk about a topic that I myself very, very little insight into because I’ve worked only very shortly in this area and so my perception about This whole thing we will talk about today is very limited because we will talk about clinical development plans and how they get established very early on in the life cycle of a, of a compound.
And for that, I’m super happy to have Carrie here on the, on the show. Hi Kerry, how are you doing?
Carrie: Good. Thanks, Alexander. Thanks for inviting me and having me on, on this podcast.
Alexander: It is super, super nice. Carrie is part of RCONIS, which [00:01:00] is still small and still pretty new company. And it’s based on just four people at the moment.
So it is Gennad Vazma, Friedrich Parker, who both worked on the, R packed R package said many of many probably know if you’re working in early phase and then Daniel Sabanese, I think is the correct pronunciation. And that’s actually Carrie’s husband. And so Carrie is the force.
On the team and I would say from all these four people, she’s the most applied one. And so I’m very, very happy to talk today about something that’s pretty applied, but before we go into the topic Carrie, maybe you can shortly introduce yourself.
Carrie: Yeah so I am a statistician and I have a degree in stats.
I’ve been working in the pharma industry for about [00:02:00] 13 years in big companies, started in big company in Boeing, going Ohio, and then I switched to Roche. And after Roche, I briefly worked Working a small company in Eidosha, and then in Vecchio Bio, and later on became Ironwood. Yeah, so that’s kind of my my work experience.
Alexander: Yeah, and I’ve been working pretty interesting to have worked in both kind of these big companies like Roche and Beringa and also small, more kind of startup companies. That’s super interesting. And we’ll actually dive a little bit into this. And the episode today. So in terms of your area, you have mostly worked in the very early clinical development area, haven’t you?
Carrie: I’ve been working in late stage. I started mostly in, in, in late stage. I, I was trial level statistician and then. Become a project lead, but [00:03:00] mostly we’re seeing in in late stage, like phase three onwards for, for the filing. But in between I work in early development as well. And so it’s kind of jumping back and forth and depending on, depending on the timing, depending on the status of the company, the strategy.
So I’ve been involved in both early and late stage.
Alexander: Cool. Very, very good. So the topic of today are clinical development plans and how they come about. So whenever I have been on on on any kind of product, yeah, there was always a clinical development plan already in place. So Kerry, how is that kind of, when actually is the first clinical development plan for any kind of compound put in place usually?
Carrie: Yeah. So usually, ideally you [00:04:00] want to have, the team wants to, to have a high level clinical development plan before the molecule, before the compound entering human, entering phase one and in non, in In non oncology, that means healthy volunteer. So you want to have that high level plant already planned.
Yeah. And there are also cases where depending on the strategy of a company, Sometimes if they license in and compound from the other company, then probably the other smaller company, they already run, they already finished phase one or phase two sometimes. So then they may or may not have a clinical development plan.
So one thing, very important, as soon as you have access. to a potential molecule that you want to very quickly grab a key [00:05:00] stakeholders, key team members into the discussion of clinical development plan. You want to start early as soon as possible.
Alexander: So when I think of a clinical development plan, How does that actually look like?
So what should a clinical development plan that is kind of, that you set up before your first phase one study starts? How does, what kind of things should
Carrie: Right. So it’s a good question. So I mean, before we talk about clinical development, maybe I briefly talk about the, the so called the target product profile.
Alexander: Ah, yes, the TPP, yeah.
Carrie: Yes, the TPP, yes, yes, because the CDP is highly tied. With the TPP.
mm-Hmm, .
So you want to have a TPP. You set up your minimum threshold, basically a minimum treatment effect you want, you want to hit, and then you know that [00:06:00] that treatment effect is considered clinically meaningful, consider considered as commercially viable.
So that’s very important. You have that minimum bar there. And then the commercial colleague or discussion with, with clinical people they will have a target to go, like they want to hit, right. And then the optimistic, like, you know, because we, because at that stage, you probably don’t know how much trim a factor you will hit.
So you want to have a. a bit more optimistic, confident
Alexander: scenarios, you actually need to hit some kind of average and some kind of, well, that would be really awesome. Yes. Yes. Yes. Yes. Right. Target
Carrie: patient profile. You
Alexander: of course, not only have the treatment effect, you have also the population, the Yes. Yeah, you have some very
Carrie: high level, the target [00:07:00] population, the very high level safety profile, you have the Primary endpoint and a little bit on the key secondary secondary endpoints listed there.
And then once you have that, then you can, you can, you can build that into your clinical development plan, your CDP, right? So then in the CDP, we all know you go, it goes from phase 1, phase 2, and then the phase 2. A very critical question is the, is the dose finding, right? Dose finding, finding the regimen, finding the right dose, find the the right regimen.
And then from there, then you start to look at the relation between the PK, PD. So you have a, after the proof concept, after the dose finding, then you roughly know what’s the, Yeah, you would have a guess, right? You would know what would be your dose, what would be your regimen. And then you plan your phase three, right?
And then the phase three, you want to power, you want to take into account of that targeted [00:08:00] or minimum trimming factor. You, you want to, you want to hit you power for that. Then you have your sample size, right? So, Phase one, phase two, phase three.
Alexander: That is very important. Yeah, that’s exactly. It’s kind of the shortest, shortest, shortest path to getting it to regulatory approval.
Yes. And when you think about regulatory approval, do you think about FDA approval there or do you think about email approval or do you just think very generic kind of thing?
Carrie: Yeah, so usually you will also you, you, you need to bring your regulatory colleague in this discussion. Depending on the disease area, depending on the landscape You know, you will take into account EMA, FDA, or sometimes the MFPA as well, PMDA as well.
Right. So then, so because what do you don’t want is that you focusing on the [00:09:00] FDA and then, and then later you, you plan to engage EMA scientific advice pretty late. And then they give you very different opinion. Then what do you do?
Alexander: Right.
Carrie: Yeah,
Alexander: different endpoint, different doses, different treatment durations, different population whatsoever.
And then you, oh, we need a complete new phase three study. Okay, that’s pretty expensive and pretty time consuming.
Carrie: Exactly. So you don’t you want to avoid that situation, right? So you, you will, you will, you will. You will take into account both if your targeted market is both U. S. and the EMA, you know, the European area you know, rest of the world.
If, if, if China population has a huge potential market, then you also want to have that engaged as well.
Alexander: When you create such a clinical development, I guess you’re not starting from a blank page. Yeah. [00:10:00] What would be your first documents or things you would look into to create a clinical development plan?
Carrie: Yeah. So usually phase one is pretty standard, right? Phase one, healthy volunteer, you do the dose escalation. That’s pretty standard. And for phase two, I will say you will, also looking to what, what data is currently available from the preclinical study, right? Because from preclinical study, you have a sense of the safety profile from the animal studies, right?
The, the dose the dose range exposure from the animal study. So you, you want to discuss with your clinical oncologist colleagues to see, you know, what kind of, Those is, is potentially you want to test it in the face to you will look into that as well. But that’s within the molecule within within the program.
And then if there are other competitors or other other [00:11:00] molecule that is same mode of action. same class. And then if they are ahead of you in the game, then you are looking to, if they have publication, then you also looking to, you know, in that molecule, in their study, how they do the study, you want to take that as kind of a reference kind of.
And then you can help you to design your, your phase two studies, for example, or even phase three. So you can, so depending on the disease, right? So similar action, existing data from the preclinical, you will, you will, you will take into that available data into account.
Alexander: Yeah.
Carrie: Yeah.
Alexander: So if you already have run dozens of studies and let’s say lung cancers and you know, you don’t have a completely new thing.
Yeah. Then you probably can build on lots of development plans that are already out there and kind of tweak it. [00:12:00] See kind of, are there any different assumptions? Would you, would you also look for kind of different? Risks around clinical development plan, because One exposure I had was to Alzheimer’s.
Yeah. And it was in Alzheimer’s. There was lots of broad discussions. Okay. Do we go really fast or do we go slow? Do we even have a phase two study? Because well, the phase two study actually needs to be so big that you can directly run a phase three study. So would you, would you consider kind of different alternative routes, kind of, you know, the super fast, medium and slow route.
Carrie: Yeah, yeah, that’s a, that’s an interesting question. You’re, you’re, you’re, you’re, you’re thinking. So usually, excuse me. So usually the CDP, you will not just have one option
you
want to the team, you should discuss with the team, different scenarios, different options. [00:13:00] And then you will list. The pros and cons of each option, for example, this is the most conservative option, right, then you can imagine probably the most conservative is very low risk, low risk in the sense that the the failure rate might be a little bit lower.
Because you, you, you spend more time, you spend more money in the early part, phase two part, you have a way of understanding of the data before you go on large scale phase three. And then it could be the approval date may be later because you have some white space. Then you want to build in the engagement with health authorities, right?
You want to take this, you can have another more aggressive option, which commercially always very open, very open. They like that kind of option, right? Very, very aggressive, but then it’s also a team’s job or, you know, to, to list what is the risk here, right? How, and then [00:14:00] once you identify the risk. And then you discuss with the team, you discuss with senior management, they may say, okay, there’s a risk, but sounds like you know, the risk is not that big.
How does it, the risk is manageable. You know, how do you want to mitigate the risk? Right. If you go with this route, if the FDA come back, or if later on something happened, like you choose the wrong dose or something, or. Yeah. Then how do you, how do you want to, how to say, rescue that that happened.
Right. So you, so you, I think it’s a very important thinking process because while you are shaping different options, that means you think different design options for phase two, phase three, or sometimes you even consider adaptive phase two, three, right. And then also like the timeline You also will force you to kind of gather what is the competitors data out there, [00:15:00] like the how to call this CI
Alexander: Competitive intelligence.
Carrie: Yes. Competitive intelligence. Right. So you also gather that information and they help you to shape different options. Yeah. So
Alexander: yeah. Yeah. Yeah. So in terms of then coming up with these kind of different design options, what kind of.
Capabilities or skills do you need to actually, you know, to be a good designer of a clinical development plan?
Carrie: I think one thing I learned over time is that I think This day is there are many interesting design, my creative design and complex design and then there are some interesting examples out there.
Some regulatory guidance there some channel, allow you to discuss with the FDA or or or scientific advice earlier. If you want [00:16:00] to have innovative design I think the FDA has some kind of complex design program pilots, something, something along like that. Right. I don’t remember the exact name. So,
Alexander: It’s called something like innovative pathways or something.
Carrie: Yeah. Yeah, exactly. Yeah. So, and that’s where I was mentioning earlier that, you know, if you’re Seeking a non conventional route in non conventional option of your CTP, then engaging a regulatory colleague is, is very important. And sometimes even through talking with FDA, they can, they may give you feedback because I, tend to think that the FDA, they see a lot of sponsors propose,
they have a larger database in terms of interesting design options. So they, they may, they may give you some hints, some direction to, to to, to, to help you [00:17:00] to, to design in, in, you know, your CDP, your, your trial in a more efficient way. Right. So, yeah.
Alexander: Yeah. Yeah. Sometimes they may I ask questions like I’ve seen that whereas this question asked about, how do you manage a specific side effect, and you think like this side effect, we never ever even talked about where this is coming from.
Only a couple of months later to find out that, Oh yeah, there was a competitor that had that side effect with a similar method of action.
And then, yeah, from these kind of hints, you can you can understand, okay. Okay. Maybe we should take care of these things. Yeah. So, so you can get some kind of indirect competence. Yes, yes, yes,
Carrie: yes, yes. That’s quite interesting, right? Yeah.
Alexander: That is very, very good. So you definitely need to have very good interactions with your regulatory people.
I [00:18:00] think another aspect. that I think is fascinating is also the money side of it, isn’t it? Because risk is one thing, speed is another thing, and the third element is usually money, yeah? So how costly these kind of clinical development plans are. How, how do you kind of estimate these costs?
Carrie: Yeah. So, as a supposition, the questions you often got to ask is, what’s the sample size here?
What’s the sample size here? Right? In, yeah, in terms of cost, it’s pretty, you know, you know, Again, I always say the CDP discussion is a cross functional one. So we contribute to the sample size, but not we, we, I use the word contribute because you want, you need to discuss with your regulator, your, your, your clinical people, you know, clinical scientists, you want to discuss with a [00:19:00] commercial, right?
And then once you agree on the effect you want to power and so on. Then you have a sample size and then you provide that number to the operations colleague, clinical operation colleague. Then they started to calculate the the enrollment and then the cost will come in, right? And then the drug supply will come in.
Right. If you said this, this X, Y, Z amount of subjects you need, then how, how does, how long this will take to enroll? How long this will take until the study complete data cleaning and so on. So all this information will gradually pile up in your CDP converted to the timeline cost will be in a Gantt chart.
Right. And then different options. You need to do this exercise for each options. Right. I mentioned we have different scenario, different options, and then you know, which one is the most costly, [00:20:00] which one is the most time consuming.
Alexander: Yeah. Right. Yeah. Yeah. Yeah. Yeah. So that all investors can make good, good decisions about things.
Yeah. I have now one specific. interesting thing and angle we want to talk about in terms of CDPs is you have both worked in a startup and small companies on clinical development plans and also in these and bigger ones. So real big ones actually. So how does that differ? What’s your experience?
Carrie: Yeah, it’s an interesting question. So, Maybe let’s start with with how this working in a big pharma, right? I mean, big pharma, I tend to think one project team, one lifecycle team is like a mini company.
Yeah. Mm.
Inside a big farm. Right. And then in a big pharma, they have different [00:21:00] therapeutic areas, different molecule, different program.
So you have another group, group of people potentially doing the portfolio management,
right? Yeah. Yeah.
I mean, you’re kind of within a big pharma, you’re kind of. If the company is doing, you know, the strategy wise, they want to develop the molecule, develop drug medication in certain disease area, if they are very determined, then they’re very committed, then probably, money cost timeline will be a less of an issue for the big pharma.
But most of the time, most of the case, especially in these days, this environment I think it’s there. Yeah, it’s, it’s through the portfolio management. And I think the project team, the project leader, when they present to the senior management, right, they want to, they, they want to present the [00:22:00] risk and then present very well, the potential of this program and why you want to basically kind of like, Asking money from the same management.
You need to sell your project. Exactly. Exactly. Basically, you need
Alexander: to sell your project internally to kind of this. Yes. For your management. Yes. Level of responsibility. Yeah. Yeah.
Carrie: Yeah. Yeah. But if you have a, if you have a Program that is not so well designed with a lot of holes, right? The senior management, they are very experienced.
They may spot it right away. Say, you know, please go back, fix this, fix that. And then we can talk about money. In a very plain language. Yeah. Yeah. Yeah. So that’s a big problem.
Alexander: It probably depends on the company culture. In some companies. Exactly. Exactly. It’s very direct. Yes. Yes.
Carrie: You may get very direct.
Exactly. Yeah. Yeah. And then [00:23:00] in a startup company is, is very different, right? Because startup, startup company mostly rely on the investors.
Alexander: So you have, and very often you have just one molecule. Yes.
Carrie: You’re kind of like one, yes. Like one asset, one, one asset company. That’s, yeah, that’s, that’s, that’s how it calls one asset company.
Right. So, you know, while we always talk about, Oh, you don’t want to put eggs in the same basket, but I’m sorry, startup company, you have no choice. You just put you on. very precious egg. You’re all one and the only egg in that basket. Right. So then, so then you want to design you want to design your CDP very carefully because that CDP will get presented to the investors.
And that’s where potentially you discuss with the investors, [00:24:00] where the key time point, we can have some early look of the data. So for allow you to have the potential opportunity to gain confident. And once you gain confidence from the earlier signal, then for a startup company, that’s the time point you can raise.
you can raise money.
Yeah.
So, yeah. So from that perspective, I think sometimes in the CDP discussion in Big Pharma and in the small startup companies, the, you have more to consider in a startup company environment,
Alexander: right? Because you can talk with different, you can potentially also talk with different investors, not just as one investor.
Yes.
Carrie: Yeah.
Alexander: Multiple investors. Yeah. Yes.
Carrie: Yeah. You can talk with different, but yes, yes, yeah. But then, yeah, because the risk is higher. Because if, [00:25:00] if that one and the only egg broke, right, then you kind of like end of the game.
Alexander: And also game for the company. Yeah.
Carrie: Yeah.
Alexander: Well, which is
Carrie: again, we’ll come.
Alexander: Yeah.
Yeah. So Or of nearly all the people in the company. Maybe they go back to the drawing board and, you know, just have a very, very few scientists leaving or staying at the company and all the other people go away. Yeah, but, but it’s yeah, that is, I think, a very, very interesting thing. How is it, Different from a kind of expertise perspective.
If you talk to, let’s say within a big player within, you know, a big pharma company you talk to upper management compared to you talk to many different investors, do they have kind of different expertise or do these kind of investors have also lots of expertise in, in And kind of community development.
Carrie: [00:26:00] Yeah. I think that’s very interesting question. The senior management in big pharma, they quite often, they, they, they’ve done what, what the team is doing in their early days in their career, right? So they have hands on experience. They know how it is. They know how it should be. They know what is the thinking process should be, and then so on.
Right. Interestingly, investors. At least the one that I, that I learned, I heard I know about that they are not very often. They are, they are more like from finance, finance world, they probably don’t have like real hands on clinical trial experience or drug development experience. You know, it’s difficult for them to pinpoint very specific questions in your CDP.
But on the other hand, what they see is that because there are different [00:27:00] companies approach them, Yeah, they see a lot of clinical development. Yeah, they see a lot of clinical development plan. So then they may say, okay, XYZ event. Okay. They probably don’t mention the name, but then they probably will say, Oh, you know, have you considered this and that?
Right. But sometimes they, because they are not real, real expert in drug development, they probably just see. tipping of a tip of an iceberg. And then they think, Oh, maybe this is, this is feasible. This can save you, save you money. They can, you can, you can gain time and have you thought about this, right. But sometimes their device may not be really like relevant, which can be quite interesting, but, but The other thing is that these days, this kind of the venture capital companies, they also have their own consultant.
They, they, they, they also may, they may also approach to expert like [00:28:00] stat experts, that’s consultant, clean farm discovery people. And so they can also say, you know, look, here’s the CDP, here’s the molecule, here’s the, here’s the information. Can you help us to judge? whether this is something worth pursuing,
right?
So yeah, so a lot of they don’t, they don’t need to be an expert but they have their ways to find an expert to help them.
Alexander: Yeah. So I think it’s, this is really, really interesting because here in this area, you can directly have a big impact on the value of your compound. or for small companies on the value of your company.
Yeah. Your expertise in terms of developing clinical development plans has a direct one to one impact on, on the value. And I think this is really, really great. Yeah there’s [00:29:00] so many areas where statisticians work, and it’s very often pretty hard to pinpoint, okay, what exactly was the value of, of that statistician.
However, here you can very easily kind of, in terms of, you know, Risk and money and time much more straightforward discuss. Okay. What is this new design I’ve made? C’s kind of different trade offs and sets value is coming from.
Carrie: Yes. Yes. Yes. Yeah. Yeah. So I think because we think about data, we think about risk.
You know, by training, you think about all those things, right? So one thing I learned over time is that in all this discussion you want to, you want to how to say you want to bring your value on the table to this cross functional team and then help them to identify. You know, if you don’t collect this [00:30:00] data, if you don’t design this one that way, what will be the trade off?
What will be, what will still remain as an open question when you go into the phase three, for example, right?
Yeah.
So yeah, it’s a, it’s an interesting it’s an interesting part of the, of the job.
Alexander: Thanks so much for this awesome discussion about clinical development plans. We talked about how they connect to the target patient profile or the target product profile.
We talked about when they actually get about what, What it looks like, what are kind of different aspects of a clinical development plan. And we also talked about the impact that statisticians have in that and how that differs from small sometimes really small companies to very big ones. Is there any.
So if you, if I’m [00:31:00] now a statistician and I really want to kind of get into this area, what would be kind of your recommendation for a statistician to learn more about developing clinical development plans?
Carrie: Yeah. So I will say statistician, I mean, you know, we all learn all those textbooks stuff, right.
And, and the technical skill, I, I think this day is You know, once you graduate from a program, you probably have no problem to apply those methods. But the CDP we’re talking about doesn’t really link to that. There’s a lot of knowledges, a lot of knowledge beyond statistics you want to learn. So then you can be a good strategist.
team player in, in, in the discussion. Like you want to learn about like more about the biology, the preclinical stuff. You know, I want to understand the other [00:32:00] product competitor landscape. You also want to learn a little bit how commercial people, how commercial colleagues think about this. You want to learn about the regulatory guidance and, and so on.
So I think, What we bring as a physician is some kind of quantified risk, a simple size, you know, that’s our base basic job. I would say job description. Right. But then beyond that, I think, to learn to gather information from other disciplines, other functions will also help you in the discussion. And the other thing is these days there are many publications about interesting designs or the molecule.
I found that reading all those like novel design or novel publicly trial molecule also helps you to think, you know, you kind of accumulating your knowledge and database. And then the next time when the team discuss different options, you’ll be like, Hey, you know, this XYZ molecule [00:33:00] in this disease, in this indication, they have done this, and then we are in a very similar situation.
How can we tweak from others example and then fitting our CDP?
Alexander: I love this advice. So basically, move on two roads. One is always increase your business understanding of what you talked about. And then the other thing is definitely stay also on top of the statistical innovation. And I know that especially in this area, there’s yet another design published.
I don’t know whether that’s on a daily basis, but probably very, very close to that. Thanks so much, Kerry, to this awesome and really fun discussion, and I’m pretty sure this won’t be the last time that we talk on this show.
Carrie: Thank you so much for having me. Thank you, Alexander.
Join The Effective Statistician LinkedIn group
This group was set up to help each other to become more effective statisticians. We’ll run challenges in this group, e.g. around writing abstracts for conferences or other projects. I’ll also post into this group further content.
I want to help the community of statisticians, data scientists, programmers and other quantitative scientists to be more influential, innovative, and effective. I believe that as a community we can help our research, our regulatory and payer systems, and ultimately physicians and patients take better decisions based on better evidence.
I work to achieve a future in which everyone can access the right evidence in the right format at the right time to make sound decisions.
When my kids are sick, I want to have good evidence to discuss with the physician about the different therapy choices.
When my mother is sick, I want her to understand the evidence and being able to understand it.
When I get sick, I want to find evidence that I can trust and that helps me to have meaningful discussions with my healthcare professionals.
I want to live in a world, where the media reports correctly about medical evidence and in which society distinguishes between fake evidence and real evidence.
Let’s work together to achieve this.