Screenomics: A Framework to Capture and Analyze Personal Life Experiences and the Ways that Technology Shapes Them

Examining Passively Collected Smartphone-Based Data in the Days Prior to Psychiatric Hospitalization for a Suicidal Crisis: Comparative Case Analysis

BACKGROUND

Digital phenotyping has seen a broad increase in application across clinical research; however, little research has implemented passive assessment approaches for suicide risk detection. There is a significant potential for a novel form of digital phenotyping, termed screenomics, which captures smartphone activity via screenshots.

OBJECTIVE

This paper focuses on a comprehensive case review of 2 participants who reported past 1-month active suicidal ideation, detailing their passive (ie, obtained via screenomics screenshot capture) and active (ie, obtained via ecological momentary assessment [EMA]) risk profiles that culminated in suicidal crises and subsequent psychiatric hospitalizations. Through this analysis, we shed light on the timescale of risk processes as they unfold before hospitalization, as well as introduce the novel application of screenomics within the field of suicide research.

METHODS

To underscore the potential benefits of screenomics in comprehending suicide risk, the analysis concentrates on a specific type of data gleaned from screenshots-text-captured prior to hospitalization, alongside self-reported EMA responses. Following a comprehensive baseline assessment, participants completed an intensive time sampling period. During this period, screenshots were collected every 5 seconds while one's phone was in use for 35 days, and EMA data were collected 6 times a day for 28 days. In our analysis, we focus on the following: suicide-related content (obtained via screenshots and EMA), risk factors theoretically and empirically relevant to suicide risk (obtained via screenshots and EMA), and social content (obtained via screenshots).

RESULTS

Our analysis revealed several key findings. First, there was a notable decrease in EMA compliance during suicidal crises, with both participants completing fewer EMAs in the days prior to hospitalization. This contrasted with an overall increase in phone usage leading up to hospitalization, which was particularly marked by heightened social use. Screenomics also captured prominent precipitating factors in each instance of suicidal crisis that were not well detected via self-report, specifically physical pain and loneliness.

CONCLUSIONS

Our preliminary findings underscore the potential of passively collected data in understanding and predicting suicidal crises. The vast number of screenshots from each participant offers a granular look into their daily digital interactions, shedding light on novel risks not captured via self-report alone. When combined with EMA assessments, screenomics provides a more comprehensive view of an individual's psychological processes in the time leading up to a suicidal crisis.

Returning Individual Research Results from Digital Phenotyping in Psychiatry

Psychiatry is rapidly adopting digital phenotyping and artificial intelligence/machine learning tools to study mental illness based on tracking participants' locations, online activity, phone and text message usage, heart rate, sleep, physical activity, and more. Existing ethical frameworks for return of individual research results (IRRs) are inadequate to guide researchers for when, if, and how to return this unprecedented number of potentially sensitive results about each participant's real-world behavior. To address this gap, we convened an interdisciplinary expert working group, supported by a National Institute of Mental Health grant. Building on established guidelines and the emerging norm of returning results in participant-centered research, we present a novel framework specific to the ethical, legal, and social implications of returning IRRs in digital phenotyping research. Our framework offers researchers, clinicians, and Institutional Review Boards (IRBs) urgently needed guidance, and the principles developed here in the context of psychiatry will be readily adaptable to other therapeutic areas.

Social Media Use and Its Concurrent and Subsequent Relation to a Biological Marker of Inflammation: Short-Term Longitudinal Study

BACKGROUND

Although many studies have examined the impact of social media use (SMU) on mental health, very few studies have examined the association of SMU with health-relevant biomarkers.

OBJECTIVE

Addressing this gap, we conducted a short-term longitudinal study examining the link between SMU and C-reactive protein (CRP), a biological marker of systemic inflammation predictive of major depression, chronic diseases, and mortality.

METHODS

We measured college students' weekly amount of SMU for 5 consecutive weeks objectively via the Screen Time app and collected blood samples at baseline and 5 weeks later.

RESULTS

In separate cross-sectional analyses conducted at phase 1 (baseline) and at phase 2 (5 weeks after baseline), objective SMU had a positive, concurrent association with CRP at both time points. Critically, in a longitudinal analysis, more SMU between phase 1 and phase 2 predicted increased CRP between these time points, suggesting that increased SMU led to heightened inflammation during that period.

CONCLUSIONS

Although more research is needed to understand why SMU led to higher inflammation, the association between objective SMU and a marker of a biological process critical to physical health presents an intriguing opportunity for future research on social media effects.

Balancing media selections over time: Emotional valence, informational content, and time intervals of use

The sequencing of information in media can influence processing of content via mechanisms like framing, mood management, and emotion regulation. This study examined three kinds of media sequences on smartphones: (1) balancing positive and negative emotional content; (2) balancing emotional content with informational content; and (3) balancing time spent on and off the media device. Actual media use was measured in natural settings using the Screenomics framework which gathers screenshots from smartphones every 5 s when devices are on. Time-series analyses of 223,531 smartphone sessions recorded from 94 participants showed that emotionally positive content was more likely to follow negative content, and that emotionally negative content was more likely to follow positive content; emotional content was more likely to follow informational content, and informational content was more likely to follow emotional content; and longer smartphone sessions were more likely to follow longer periods of non-use.

ScreenLife Capture: An open-source and user-friendly framework for collecting screenomes from Android smartphones

As our interactions with each other become increasingly digitally mediated, there is growing interest in the study of people's digital experiences. To better understand digital experiences, some researchers have proposed the use of screenomes. This involves the collection of sequential high-frequency screenshots which provide detailed objective records of individuals' interaction with screen devices over time. Despite its usefulness, there remains no readily available tool that researchers can use to run their own screenome studies. To fill this gap, we introduce ScreenLife Capture, a user-friendly and open-source software to collect screenomes from smartphones. Using this tool, researchers can set up smartphone screenome studies even with limited programming knowledge and resources. We piloted the tool in an exploratory mixed-method study of 20 college students, collecting over 740,000 screenshots over a 2-week period. We found that smartphone use is highly heterogeneous, characterized by threads of experiences. Using in-depth interviews, we also explored the impact that constant background surveillance of smartphone use had on participants. Participants generally had slight psychological discomfort which fades after a few days, would suspend screen recording for activity perceived to be extremely private, and recounted slight changes in behavior. Implications for future research is discussed.

The Affective Dynamics of Everyday Digital Life: Opening Computational Possibility

Up to now, there was no way to observe and track the affective impacts of the massive amount of complex visual stimuli that people encounter "in the wild" during their many hours of digital life. In this paper, we propose and illustrate how recent advances in AI-trained ensembles of deep neural networks-can be deployed on new data streams that are long sequences of screenshots of study participants' smartphones obtained unobtrusively during everyday life. We obtained affective valence and arousal ratings of hundreds of images drawn from existing picture repositories often used in psychological studies, and a new screenshot repository chronicling individuals' everyday digital life from both N = 832 adults and an affect computation model (Parry & Vuong, 2021). Results and analysis suggest that (a) our sample rates images similarly to other samples used in psychological studies, (b) the affect computation model is able to assign valence and arousal ratings similarly to humans, and (c) the resulting computational pipeline can be deployed at scale to obtain detailed maps of the affective space individuals travel through on their smartphones. Leveraging innovative methods for tracking the emotional content individuals encounter on their smartphones, we open the possibility for large-scale studies of how the affective dynamics of everyday digital life shape individuals' moment-to-moment experiences and well-being.

Supplementary Information

The online version contains supplementary material available at 10.1007/s42761-023-00202-4.

Users choose to engage with more partisan news than they are exposed to on Google Search

If popular online platforms systematically expose their users to partisan and unreliable news, they could potentially contribute to societal issues such as rising political polarization^1,2. This concern is central to the 'echo chamber'^3-5 and 'filter bubble'^6,7 debates, which critique the roles that user choice and algorithmic curation play in guiding users to different online information sources^8-10. These roles can be measured as exposure, defined as the URLs shown to users by online platforms, and engagement, defined as the URLs selected by users. However, owing to the challenges of obtaining ecologically valid exposure data-what real users were shown during their typical platform use-research in this vein typically relies on engagement data^4,8,11-16 or estimates of hypothetical exposure^17-23. Studies involving ecological exposure have therefore been rare, and largely limited to social media platforms^7,24, leaving open questions about web search engines. To address these gaps, we conducted a two-wave study pairing surveys with ecologically valid measures of both exposure and engagement on Google Search during the 2018 and 2020 US elections. In both waves, we found more identity-congruent and unreliable news sources in participants' engagement choices, both within Google Search and overall, than they were exposed to in their Google Search results. These results indicate that exposure to and engagement with partisan or unreliable news on Google Search are driven not primarily by algorithmic curation but by users' own choices.

Media Production on Smartphones: Analysis of the Timing, Content, and Context of Message Production Using Real-World Smartphone Use Data

Although media production is a critical concept in communication theory, we know surprisingly little about the timing, content, and context of individuals' production behavior. Intensive observation and analysis of 94 American adults' smartphone use over 1 week showed that although time spent in producing content was on average only about 6 percent of the amount of time spent on smartphones, the production content was more purposeful, expressive, articulate, condensed, confident, personal, and emotionally charged than consumption content. Analysis of the temporal dynamics of production suggests that the content consumed in the minute before individuals' production began to resemble the subsequently produced content. Other results suggest that content production on smartphones was fragmented, idiosyncratic, and purposeful, highlighting the impact of individuals' quick interactions with media, and the need to develop user-centric theories about how, when, and why individuals produce digital content.

To use or be used? The role of agency in social media use and well-being

In this paper, we develop the concept of agentic social media use: a way of engaging with social media that emphasizes having the beliefs, knowledge, and practices to use it intentionally. In comparison to instances of “mindless” social media use, people who use social media agentically do so with a purpose in mind: they leverage the affordances of social media to do things that are meaningful, useful, or satisfying for them. For example, people can use social media to intentionally build or manage their relationships, to seek out and learn new information about their interests, or to craft a positive image of themselves through the content they post. Crucially, however, there are many other valuable uses of social media that may not be considered conventionally productive but are nonetheless deliberate and useful, such as using social media intentionally to relax, unwind, and entertain themselves in an effort to modulate their emotions. To use social media agentically means to (1) hold an agentic mindset about one's relationship with social media, (2) have the knowledge and literacy to understand how to navigate social media effectively, and (3) enact practices that assert control over specific elements of social media use, such as curating content and refining algorithmic recommendation. Approaching social media use from the perspective of agency and intentionality allows us to better understand heterogeneous social media effects and to identify new ways of helping people benefit from these technologies.

Are mobile phone ownership and age of acquisition associated with child adjustment? A 5-year prospective study among low-income Latinx children

This prospective, longitudinal study examined associations between whether and when children first acquire a mobile phone and their adjustment measures, among low-income Latinx children. Children (N = 263; 55% female; baseline M_age  = 9.5) and their parents were assessed annually for 5 years from 2012. Children first acquired a mobile phone at a mean (SD) age of 11.62 (1.41) years. Pre-registered multilevel models tested associations linking phone ownership, phone acquisition age, and the interaction between ownership and acquisition age to levels and changing trends of depressive symptoms, school grades, and reported and objectively assessed sleep. Results showed no statistically significant associations, controlling the False Discovery Rate. Findings suggest an absence of meaningful links from mobile phone ownership and acquisition age to child adjustment.

Strategic use of internal and external memory in everyday life: episodic, semantic, procedural, and prospective purposes

Humans have access to both internal memory (information stored in the brain) and external memory (information stored in the environment). To what extent do we use each in everyday life? In two experiments, participants rated both internal and external memory for frequency of use, dependability, ease of use (Experiment 1), and likelihood of use (Experiment 2) across four purposes: episodic, semantic, procedural, and prospective. Experiment 1 showed that internal memory was favoured for episodic and procedural purposes, while external memory was favoured for semantic purposes. Experiment 2 further clarified that internal memory was favoured for episodic and common procedural purposes, while external memory was favoured for uncommon semantic, uncommon procedural, and far-term prospective purposes. This strategic division of labour plays to the strengths of both forms of memory. Participants also generally rated external memory as more dependable and easier to use. Results support the memory symbiosis framework.

Developing a digital competence scale for teachers: validity and reliability study

Teachers' digital competence is very significant in terms of integrating digital technologies into the education process. This study aims to develop an up-to-date scale that can determine the digital competencies required for teachers to acquire new skills that arise with the change and development of technology and use them in educational environments. A total of 695 teachers participated in the study. Exploratory and confirmatory factor analyses were used to examine the construct validity of the scale. To assess the discrimination index of the items, the lower 27% and upper 27% groups were determined, and the differences between the groups were examined. Internal consistency coefficients were calculated for the reliability analysis. According to the results of the analysis, the developed scale consists of six factors and 46 items, and the Cronbach Alpha coefficient of the entire scale is 0.975. The factors were identified as "Safety," "Data Literacy," "Problem Solving," "Digital Content Creation," "Communication and Collaboration," and "Ethics," respectively, according to the content of the items. When compared with the DigComp 2.1 framework developed by the European Union, it was determined that the ethical factor emerged differently in this study. As a result, it can be said that the Digital Competency Scale for Teachers is a valid and reliable scale that can be used to measure teachers' digital competencies.

Mementos from digital worlds: video game photography as documentation

Purpose

Video game players, equipped with image capturing and rendering features, are taking photographs within digital worlds. This study examines video game photography as a documentary practice. By considering the experiences of a gamer-turned-photographer, this study offers an initial synthesis of this new document phenomenon and provides considerations for categorizing such photos.

Design/methodology/approach

To discover the attributes of video game photography, this study utilized an auto-hermeneutic approach with self-interviewing and picture-sorting techniques. The resulting data were analyzed using interpretative phenomenological analysis.

Findings

Without tangible artifacts to commemorate gaming experiences, photographs empower the player to document and artistically reconstruct moments from purely digital worlds. The three themes from this study's findings – that video game photographs act as (1) vehicles for storytelling, (2) creative trophies, and (3) aesthetic tokens – reveal how personally meaningful documents emerge from this medium. Furthermore, the findings uncover the fuzzy boundaries between play, artwork, and documentation.

Practical implications

This study explores techniques for categorizing in-game photographs and eliciting gameplay memories. The methods outlined may assist video game researchers, conservators, and archivists with organizing photographs as context materials.

Originality/value

By considering the lived experiences between one individual and their video game photographs, this study expands document theory into the underrepresented hobby of video games.

The problem with the internet: An affordance-based approach for psychological research on networked technologies

The internet is often viewed as the source of a myriad of benefits and harms. However, there are problems with using this notion of "the internet" and other high-level concepts to explain the influence of communicating via everyday networked technologies on people and society. Here, we argue that research on social influence in computer-mediated communication (CMC) requires increased precision around how and why specific features of networked technologies interact with and impact psychological processes and outcomes. By reviewing research on the affordances of networked technologies, we demonstrate how the relationship between features of "the internet" and "online behaviour" can be determined by both the affordances of the environment and the psychology of the user and community. To achieve advances in this field, we argue that psychological science must provide nuanced and precise conceptualisations, operationalisations, and measurements of "internet use" and "online behaviour". We provide a template for how future research can become more systematic by examining how and why variables associated with the individual user, networked technologies, and the online community interact and intersect. If adopted, psychological science will be able to make more meaningful predictions about online and offline outcomes associated with communicating via networked technologies.

Impact of mobile phones and wireless devices use on children and adolescents' mental health: a systematic review

Growing use of mobiles phones (MP) and other wireless devices (WD) has raised concerns about their possible effects on children and adolescents' wellbeing. Understanding whether these technologies affect children and adolescents' mental health in positive or detrimental ways has become more urgent following further increase in use since the COVID-19 outbreak. To review the empirical evidence on associations between use of MP/WD and mental health in children and adolescents. A systematic review of literature was carried out on Medline, Embase and PsycINFO for studies published prior to July 15th 2019, PROSPERO ID: CRD42019146750. 25 observational studies published between January 1st 2011 and 2019 were reviewed (ten were cohort studies, 15 were cross-sectional). Overall estimated participant mean age and proportion female were 14.6 years and 47%, respectively. Substantial between-study heterogeneity in design and measurement of MP/WD usage and mental health outcomes limited our ability to infer general conclusions. Observed effects differed depending on time and type of MP/WD usage. We found suggestive but limited evidence that greater use of MP/WD may be associated with poorer mental health in children and adolescents. Risk of bias was rated as 'high' for 16 studies, 'moderate' for five studies and 'low' for four studies. More high-quality longitudinal studies and mechanistic research are needed to clarify the role of sleep and of type of MP/WD use (e.g. social media) on mental health trajectories in children and adolescents.

Duration, frequency, and time distortion: Which is the best predictor of problematic smartphone use in adolescents? A trace data study

Problematic smartphone use (PSU) during adolescence has been associated with negative short- and long-term consequences for personal well-being and development. Valid and reliable predictors and indicators of PSU are urgently needed, and digital trace data can add valuable information beyond self-report data. The present study aimed to investigate whether trace data (duration and frequency of smartphone use), recorded via an app installed on participants’ smartphone, are correlated with self-report data on smartphone use. Additionally, the present study aimed to explore which usage indicators, i.e., duration, frequency, and time distortion of smartphone use, better predict PSU levels cross-sectionally and longitudinally, one year later. Results from a sample of 84 adolescents showed that adolescents tend to rely on the frequency of smartphone use when reporting on the time they spent with the smartphone. Traced duration of smartphone use as well as time distortion, i.e., over-estimation, are significant predictors of PSU. Methodological issues and theoretical implications related to predictors and indicators of PSU are discussed.

From Wellbeing to Social Media and Back: A Multi-Method Approach to Assessing the Bi-Directional Relationship Between Wellbeing and Social Media Use

Literature concerning the relationship between social media use and wellbeing is inconsistent in its findings, and most research has focused on time spent on social media rather than on what emerging adults do there, with whom and why. Here, we investigated whether momentary social stress affects emerging adults’ social media use, and whether this social media use relates to subsequent changes in wellbeing. We implemented a multi-method paradigm utilising objective and self-report data to investigate how social stress relates to how (much) and why emerging adults use social media. We report on findings based on 114 17–25-year-old emerging adults recruited on university campus. Our findings suggest that social stress does not affect adolescents’ subsequent social media use and that there is no relationship between social media use after stress and changes in momentary wellbeing. Our work illustrates the need for detailed approaches in social media and psychological wellbeing research.

Researching the Links between Smartphone Behavior and Adolescent Wellbeing: The Study Protocol for the FUTURE (WP4) Ecological Momentary Assessment Study (Preprint)

Background

Smartphone ownership has increased among teens within the last decade, with up to 89% of adolescents owning a smartphone and engaging daily with the online world through it. Although the results of recent meta-analyses suggest that engaging digital technology plays only a small role in adolescent well-being, parents, professionals, and policymakers remain concerned about the impact that the instant connectivity of smartphones has on adolescent well-being.

Objective

Herein, we introduce the protocol of a research study investigating the associations between adolescent smartphone use and different facets of well-being (social, physical, and psychological), with the aim to apply innovative methods to address the limitations of existing empirical studies.

Methods

This 12-month prospective study of adolescents uses a repeated measurement-burst design with the ecological momentary assessment methodology. Adolescents (N=203; age range 13-17 years) complete baseline assessments through online questionnaires, four 14-day intensive data collection bursts, and an online questionnaire at the end of the study. As part of the 4 measurement bursts, adolescent smartphone behavior is assessed objectively by passive data collection of smartphone data logs and through self-reports in short questionnaires administered via a custom-built Android app.

Results

The protocol describes the study objectives, research tools (including the development of the Android app and specialized software), and process (including pilot studies, the main study, and targets for machine learning approaches). Two of the 203 enrolled participants provided no data during the first data collection burst of the main study. Preliminary analyses of the data from the first data collection burst indicated an acceptable level of compliance (72.25%) with the daily questionnaires. The design of the study will allow for the assessment of both within- and between-person variabilities in smartphone behavior, as well as short-term variation and long-term change in smartphone behavior and how it impacts the indicators of social, physical, and psychological well-being.

Conclusions

The innovative methods applied in this study (objective smartphone logs, ecological momentary assessment, and machine learning) will allow for a more nuanced assessment of the links between smartphone use and well-being, informing strategies to help adolescents navigate the online world more constructively in terms of the development of their physical, social, and psychological well-being.

International Registered Report Identifier (IRRID)

DERR1-10.2196/35984

Social media use and its impact on adolescent mental health: An umbrella review of the evidence

Literature reviews on how social media use affects adolescent mental health have accumulated at an unprecedented rate of late. Yet, a higher-level integration of the evidence is still lacking. We fill this gap with an up-to-date umbrella review, a review of reviews published between 2019 and mid-2021. Our search yielded 25 reviews: seven meta-analyses, nine systematic, and nine narrative reviews. Results showed that most reviews interpreted the associations between social media use and mental health as 'weak' or 'inconsistent,' whereas a few qualified the same associations as 'substantial' and 'deleterious.' We summarize the gaps identified in the reviews, provide an explanation for their diverging interpretations, and suggest several avenues for future research.

Social Connectedness, Excessive Screen Time During COVID-19 and Mental Health: A Review of Current Evidence

With an advancement of digital technology, excessive screen time has become a grave concern. This has pushed researchers and practitioners to focus on digital well-being. Screen time during COVID-19 has further increased as a result of public health measures enforced by governments to curb the pandemic. With the global societies under lockdown, the only medium to stay socio- emotionally connected was the digital one. A lack of comprehensive empirical overviews on screen time in COVID-19 era in the present literature prompted us to conduct this review. The present review attempts to understand the virtual social connectedness, excessive use of digital technology, its consequences and suggest strategies to maintain healthy use of digital technology. Results reveal that screen time has increased drastically during COVID-19. Though there are mixed consequences of prolonged screen time use and blurred understanding between healthy and unhealthy social connectedness over digital media, the suggestions for negative implications on (physical and) mental health warrant a strict need for inculcating healthy digital habits, especially knowing that digital technology is here to stay and grow with time.

Do New Romantic Couples Use More Similar Language Over Time? Evidence from Intensive Longitudinal Text Messages

The digital text traces left by computer-mediated communication (CMC) provide a new opportunity to test theories of relational processes that were originally developed through observation of face-to-face interactions. Communication accommodation theory, for example, suggests that conversation partners' verbal (and non-verbal) behaviors become more similar as relationships develop. Using a corpus of 1+ million text messages that 41 college-age romantic couples sent to each other during their first year of dating, this study examines how linguistic alignment of new romantic couples' CMC changes during relationship formation. Results from nonlinear growth models indicate that three aspects of daily linguistic alignment (syntactic-language style matching, semantic-latent semantic analysis, overall-cosine similarity) all exhibit exponential growth to an asymptote as romantic relationships form. Beyond providing empirical support that communication accommodation theory also applies in romantic partners' CMC, this study demonstrates how relational processes can be examined using digital trace data.

Ethical issues in using ambient intelligence in health-care settings

Ambient intelligence is increasingly finding applications in health-care settings, such as helping to ensure clinician and patient safety by monitoring staff compliance with clinical best practices or relieving staff of burdensome documentation tasks. Ambient intelligence involves using contactless sensors and contact-based wearable devices embedded in health-care settings to collect data (eg, imaging data of physical spaces, audio data, or body temperature), coupled with machine learning algorithms to efficiently and effectively interpret these data. Despite the promise of ambient intelligence to improve quality of care, the continuous collection of large amounts of sensor data in health-care settings presents ethical challenges, particularly in terms of privacy, data management, bias and fairness, and informed consent. Navigating these ethical issues is crucial not only for the success of individual uses, but for acceptance of the field as a whole.

#Science: The Potential and the Challenges of Utilizing Social Media and Other Electronic Communication Platforms in Health Care

Electronic communication is becoming increasingly popular worldwide, as evidenced by its widespread and rapidly growing use. In medicine, however, it remains a novel approach to reach out to patients. Yet, they have the potential for further improving current health care. Electronic platforms could support therapy adherence and communication between physicians and patients. The power of social media as well as other electronic devices can improve adherence as evidenced by the development of the app bant. Additionally, systemic analysis of social media content by Screenome can identify health events not always captured by regular health care. By better identifying these healthcare events we can improve our current healthcare system as we will be able to better tailor to the patients' needs. All these techniques are a valuable component of modern health care and will help us into the future of increasingly digital health care.

Screenomics: A New Approach for Observing and Studying Individuals' Digital Lives

AIMS

This study describes when and how adolescents engage with their fast-moving and dynamic digital environment as they go about their daily lives. We illustrate a new approach - screenomics - for capturing, visualizing, and analyzing screenomes, the record of individuals' day-to-day digital experiences.

SAMPLE

Over 500,000 smartphone screenshots provided by four Latino/Hispanic youth, age 14-15 years, from low-income, racial/ethnic minority neighborhoods.

METHOD

Screenomes collected from smartphones for one to three months, as sequences of smartphone screenshots obtained every five seconds that the device is activated, are analyzed using computational machinery for processing images and text, machine learning algorithms, human-labeling, and qualitative inquiry.

FINDINGS

Adolescents' digital lives differ substantially across persons, days, hours, and minutes. Screenomes highlight the extent of switching among multiple applications, and how each adolescent is exposed to different content at different times for different durations - with apps, food-related content, and sentiment as illustrative examples.

IMPLICATIONS

We propose that the screenome provides the fine granularity of data needed to study individuals' digital lives, for testing existing theories about media use, and for generation of new theory about the interplay between digital media and development.