Examples of using Digital experiments in English and their translations into Hebrew
{-}
-
Colloquial
-
Ecclesiastic
-
Computer
-
Programming
Figure 4.18: Schematic of cost structures in analog and digital experiments.
In other words, digital experiments are not just online experiments. .
Even ifyou don't work at a big tech company you can run digital experiments.
Fortunately, the low cost of some digital experiments makes multi-experiment studies easier.
But, if you don't work at a techcompany you might think that you can't run digital experiments.
This change in scale is because some digital experiments can produce data at zero variable cost.
By this point,I hope that you are excited about the possibilities of doing your own digital experiments.
When some people think of digital experiments, they immediately think of online experiments. .
This point is so important, I will return to it toward the end of thechapter when I offer advice about creating digital experiments.
In between these two extremes, there are partially digital experiments that use a combination of analog and digital systems.
In general, amplified asking will probably have high fixed costs andlow variable costs similar to digital experiments(see Chapter 4).
The different cost structures mean that digital experiments can run at a scale that is not possible with analog experiments. .
Now, however,researchers should also organize experiments along a continuum between analog experiments and digital experiments.
Even though digital experiments have low variable costs, you can create a lot of exciting opportunities when you drive the variable cost all the way to zero.
This is unfortunate because the opportunities to run digital experiments are not just online.
Digital experiments can have dramatically different cost structures, and this enables researchers to run experiments that were impossible in the past.
In general, analog experiments have low fixed costs andhigh variable costs whereas digital experiments have high fixed costs and low variable costs.
Then, in section 4.3, I will describe the difference between lab experiments and field experiments andthe differences between analog experiments and digital experiments.
In general, analog experiments have low fixed costs andhigh variable costs whereas digital experiments have high fixed costs and low variable costs.
When researchers already have pre-treatment information,as is the case in many digital experiments, mixed designs are generally preferable to between-subjects designs because they result in improved precision of estimates.
As digital devices become increasingly integrated into people's lives and sensors become integrated into the built environment,these opportunities to run partially digital experiments in the physical world will increase dramatically.
Finally, to foreshadow an idea that will come later whenI offer advice about designing digital experiments, a_mixed design_combines the improved precision of within-subjects designs and the protection against confounding of between-subjects designs(figure 4.5).
In addition to being a nice illustration of the mechanics of experiments, Restivo andvan de Rijt's study also shows that the logistics of digital experiments can be completely different from those of analog experiments. .
In general, analog experiments have low fixedcosts and high variable costs, and digital experiments have high fixed costs and low variable costs(Figure 4.18).
Not only can researchers run massive experiments, they can also take advantage of the specific nature of digital experiments to improve validity, estimate heterogeneity of treatment effects, and isolate mechanisms.