Arvindharvindharul.com·Apr 17, 2024Growth Hacking StoriesThis is a space for recording some of the stories that I have found interesting. Airbnb As a data scientist, I was fascinated by the creative, experimental approach Airbnb used in the early days to rapidly expand into new international markets. The c...Discussexperimentation
Adnan ChowdhuryforGrowthBook Engineering Blogblog.growthbook.io·Feb 27, 2024Code ReferencesAs companies grow, they often find themselves increasingly reliant on feature flags. While these are valuable tools, they sometimes linger in the codebase, leading to technical debt. It's important for developers to be aware of this and consider regu...Discussgrowthbook
Arvindharvindharul.com·Feb 14, 2024Synthetic Control MatchingWhen measuring the impact of a change we tend to compare the effects before and after an experiment. But this overly simplifies our ability to truly estimate the difference. To truly understand the impact we need to understand what would have happene...Discusssynthetic-control
Arvindharvindharul.com·Jan 31, 2024Sample Ratio Mismatch (SRM) Cheatsheet: Understanding and Addressing Experimental DiscrepanciesSample Ratio Mismatch (SRM) refers to the difference between how we planned to split participants in an experiment and how it actually turned out. For instance, if we intended a 50/50 split but ended up with a 60/40 distribution, that's an SRM. SRMs ...Discuss#ABTesting
Arvindharvindharul.com·Jan 30, 2024A/B Testing and Experimentation ChecklistEmbarking on an experimentation journey requires meticulous planning and a well-defined roadmap to ensure the reliability of results. In this guide, we'll explore the critical steps involved in crafting a successful experiment, from formulating a hyp...Discussexperimentation
Luke SonnetforGrowthBook Engineering Blogblog.growthbook.io·Jan 19, 2024Changing Running Experiments Safely and Flexibly in GrowthBookRunning experiments can be a messy business and you often want to make changes mid-experiment. Making changes to running experiments in GrowthBook 2.7 is: Safer than ever. With guided flows that ensure you don’t introduce bias when changing targetin...Discuss·103 readsab testing
Michael KnowltonforGrowthBook Engineering Blogblog.growthbook.io·Nov 28, 2023Boost Confidence in Experiment Launches with GrowthBook's Pre-Launch ChecklistsAt GrowthBook, our mission has always been to empower organizations to optimize their online experiments seamlessly. We are thrilled to announce our latest feature— Customizable Pre-Launch Checklists. Experimentation is at the heart of progress, but ...Discuss·182 readsexperimentation
Muhammed Alimuhammed-ali.hashnode.dev·Sep 24, 2023Integrating Comet with PyTorch for Enhanced Deep Learning ExperimentationAs the field of deep learning advances, researchers and practitioners are constantly seeking ways to streamline their experimentation processes, gain insights into model performance, and collaborate effectively. One tool that has gained popularity in...DiscussDeep Learning
Michael KnowltonforGrowthBook Engineering Blogblog.growthbook.io·Jul 28, 2023New Feature: Save time with Automatic Metric Generation!In the fast-paced world of software development, staying ahead of the competition and continuously improving your product is crucial for success. One of the most powerful tools at a software company's disposal is feature flagging and experimentation....Discuss·311 reads feature flags
Casper Weiss Bangblog.cwb.dk·Jun 18, 2023Are standups dead in a fully-remote team?I've always been a fan of the different scrum-inspired rituals, however after working fully remote for 9 months, I start to question whether it adds value, or is simply costing us an hour of productivity each day. What is the value of a standup? The...Discuss·39 readsagile