Examples of using Digital experiments in English and their translations into Finnish
{-}
-
Colloquial
-
Official
-
Medicine
-
Financial
-
Ecclesiastic
-
Official/political
-
Computer
-
Programming
In other words, digital experiments are not just online experiments. .
Even if you don't work at a big tech company you can run digital experiments.
This change in scale is because some digital experiments can produce data at zero variable cost.
Figure 4.19: Schematic of cost structures in analog and digital experiments.
In conclusion, digital experiments can have dramatically different cost structures than analog experiments. .
Figure 4.18: Schematic of cost structures in analog and digital experiments.
The different cost structures mean that digital experiments can run at a scale that is not possible with analog experiments. .
But, if you don't work at a tech company you might think that you can't run digital experiments.
In digital experiments, however, these data constraints are less common because researchers tend to have more participants and know more about them.
The second piece of advice that I would like to offer about designing digital experiments concerns ethics.
Even though digital experiments have low variable costs, you can create a lot of exciting opportunities when you drive the variable cost all the way to zero.
The second piece of advice that I would like to offer about designing digital experiments concerns ethics.
Researchers can run partially digital experiments by using digital devices in the physical world in order to deliver treatments or measure outcomes.
By this point,I hope that you are excited about the possibilities of doing your own digital experiments.
Digital experiments can have dramatically different cost structures and this enables researchers to run experiments that were impossible in the past.
This point is so important, I will return to it towards the end of the chapter when I offer advice about creating digital experiments.
As I described in Chapter 5,researchers can increasingly design and build digital experiments with zero variable costs, a cost structure that enables extremely large experiments. .
Now, however, researchers should also organize experiments along a continuum between analog experiments and digital experiments.
In general, analog experiments have low fixed costs andhigh variable costs, and digital experiments have high fixed costs and low variable costs Figure 4.18.
Read Cialdini's paper, andwrite him an email urging him to reconsider his break-up in light of the possibilities of digital experiments.
In general, analog experiments have low fixed costs andhigh variable costs, while digital experiments have high fixed costs and low variable costs figure 4.19.
But in digital experiments, particularly those with zero variable cost, researchers don't face a cost constraint on the size of their experiment, and this has the potential to lead to unnecessarily large experiments. .
Thus, I expect that construct validity will tend to be a bigger concern in digital experiments than analog experiments. .
In digital experiments where researchers partner with companies or governments to deliver treatments and use always-on data systems to measure outcomes, the match between the experiment and the theoretical constructs may be less tight.
In general, amplified asking will probably have high fixed costs andlow variable costs similar to digital experiments see Chapter 4.
When researchers already have pre-treatment information,as is the case in many digital experiments, mixed designs are preferable to between-subjects designs because of gains in precision see Technical Appendix.
The paper-which originally had the provocative title"On the Near-impossibility of Measuring the Returns to Advertising"-shows how difficult it is to measure the return on investment of online ads, even with digital experiments involving millions of customers.
It is tricky to offer a formal definition of this dimension, buta useful working definition is that fully digital experiments are experiments that make use of digital infrastructure to recruit participants, randomize, deliver treatments, and measure outcomes.
Their paper-which originally had the provocative title"On the Near-Impossibility of Measuring the Returns to Advertising"-showshow difficult it is to measure the return on investment of online ads, even with digital experiments involving millions of customers.
In general, analog experiments have low fixed costs andhigh variable costs whereas digital experiments have high fixed costs and low variable costs.