{"id":107714,"date":"2025-08-25T00:59:10","date_gmt":"2025-08-25T00:59:10","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/107714\/"},"modified":"2025-08-25T00:59:10","modified_gmt":"2025-08-25T00:59:10","slug":"development-of-an-alcohol-biosensor-non-wear-algorithm-laboratory-based-machine-learning-and-field-based-deployment","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/107714\/","title":{"rendered":"Development of an alcohol biosensor non-wear algorithm: laboratory-based machine learning and field-based deployment"},"content":{"rendered":"<p>Methods: laboratory studyParticipants<\/p>\n<p>Biosensor readings were collected during laboratory sessions from 36 participants (Table <a data-track=\"click\" data-track-label=\"link\" data-track-action=\"table anchor\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#Tab1\" rel=\"nofollow noopener\" target=\"_blank\">1<\/a>) enrolled in a larger investigation of subjective and objective responses to a fixed-dose oral alcohol challenge and their associations to future drinking outcomes<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"King, A. C., de Wit, H., McNamara, P. J. &amp; Cao, D. Rewarding, stimulant, and sedative alcohol responses and relationship to future binge drinking. Arch. Gen. Psychiatry 68, 389&#x2013;399 (2011).\" href=\"#ref-CR24\" id=\"ref-link-section-d337729415e604\">24<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"King, A. C., McNamara, P. J., Hasin, D. S. &amp; Cao, D. Alcohol challenge responses predict future alcohol use disorder symptoms: A 6-year prospective study. Biol. Psychiatry 75, 798&#x2013;806 (2014).\" href=\"#ref-CR25\" id=\"ref-link-section-d337729415e604_1\">25<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 26\" title=\"King, A. C. et al. Subjective responses to alcohol in the development and maintenance of alcohol use disorder. Am. J. Psychiatry 178, 560&#x2013;571 (2021).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR26\" id=\"ref-link-section-d337729415e607\" rel=\"nofollow noopener\" target=\"_blank\">26<\/a>.<\/p>\n<p>Table 1 Sample characteristics.<\/p>\n<p>At a screening visit, participants completed informed consent, verified their identity with a photo ID, provided biological samples (breath, urine, and blood), and filled out surveys on health, alcohol, and substance use<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 27\" title=\"Sobell, L. C. &amp; Sobell, M. B. Timeline follow-back. in Measuring Alcohol Consumption: Psychosocial and Biochemical Methods (eds Litten, R. Z. &amp; Allen, J. P.) 41&#x2013;72 (Humana Press, Totowa, NJ, 1992). &#010;                  https:\/\/doi.org\/10.1007\/978-1-4612-0357-5_3&#010;                  &#010;                .\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR27\" id=\"ref-link-section-d337729415e890\" rel=\"nofollow noopener\" target=\"_blank\">27<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 28\" title=\"Rueger, S. Y., Trela, C. J., Palmeri, M. &amp; King, A. C. Self-administered web-based timeline followback procedure for drinking and smoking behaviors in young adults. J. Stud. Alcohol Drugs 73, 829&#x2013;833 (2012).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR28\" id=\"ref-link-section-d337729415e893\" rel=\"nofollow noopener\" target=\"_blank\">28<\/a>. Participants met the study age criteria (40\u201365\u00a0years old) and were approved by the study physician based on their blood pressure, liver enzymes, medications, and substance\/medical history. Full eligibility criteria can be found elsewhere<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 29\" title=\"Didier, N., Cao, D. &amp; King, A. C. The eyes have it: Alcohol-induced eye movement impairment and perceived impairment in older adults with and without alcohol use disorder. Alcohol Clin. Exp. Res. 49, 437&#x2013;447 (2025).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR29\" id=\"ref-link-section-d337729415e897\" rel=\"nofollow noopener\" target=\"_blank\">29<\/a>.<\/p>\n<p>Procedures<\/p>\n<p>All study methods were fully approved by the University of Chicago Institutional Review Board. The study was conducted in accordance with governmental regulations and guidelines set by the Declaration of Helsinki. In brief, participants completed two individual double-blinded beverage administration sessions at the Clinical Addictions Research Laboratory at the University of Chicago. Upon arrival, each participant completed breathalyzer, drug, and pregnancy tests (for females) to ensure safety of participation. On separate study days and in random order, each participant consumed either a 0.8\u00a0g\/kg alcohol beverage or a placebo beverage within a 15-min period<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 24\" title=\"King, A. C., de Wit, H., McNamara, P. J. &amp; Cao, D. Rewarding, stimulant, and sedative alcohol responses and relationship to future binge drinking. Arch. Gen. Psychiatry 68, 389&#x2013;399 (2011).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR24\" id=\"ref-link-section-d337729415e909\" rel=\"nofollow noopener\" target=\"_blank\">24<\/a>. Before and several timepoints after beverage administration, participants completed a series of surveys and hand\u2013eye coordination tasks with their non-dominant (biosensor-equipped) hand. Laboratory sessions took place in furnished, windowed rooms with an ambient temperature ranging from 19\u201324\u00a0\u00b0C (66\u201375\u00b0F). For completing all study components (screening, laboratory study, and an ambulatory phase beyond the scope of this report), participants were compensated $400 ($250 plus a $150 completion bonus). Additional details on the laboratory protocol can be found elsewhere<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 24\" title=\"King, A. C., de Wit, H., McNamara, P. J. &amp; Cao, D. Rewarding, stimulant, and sedative alcohol responses and relationship to future binge drinking. Arch. Gen. Psychiatry 68, 389&#x2013;399 (2011).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR24\" id=\"ref-link-section-d337729415e913\" rel=\"nofollow noopener\" target=\"_blank\">24<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 25\" title=\"King, A. C., McNamara, P. J., Hasin, D. S. &amp; Cao, D. Alcohol challenge responses predict future alcohol use disorder symptoms: A 6-year prospective study. Biol. Psychiatry 75, 798&#x2013;806 (2014).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR25\" id=\"ref-link-section-d337729415e916\" rel=\"nofollow noopener\" target=\"_blank\">25<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Didier, N., Cao, D. &amp; King, A. C. The eyes have it: Alcohol-induced eye movement impairment and perceived impairment in older adults with and without alcohol use disorder. Alcohol Clin. Exp. Res. 49, 437&#x2013;447 (2025).\" href=\"#ref-CR29\" id=\"ref-link-section-d337729415e919\">29<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Didier, N., Vena, A., Feather, A. R., Grant, J. E. &amp; King, A. C. Holding your liquor: Comparison of alcohol-induced psychomotor impairment in drinkers with and without alcohol use disorder. Alcohol Clin. Exp. Res. 47, 1156&#x2013;1166 (2023).\" href=\"#ref-CR30\" id=\"ref-link-section-d337729415e919_1\">30<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 31\" title=\"Roche, D. J. O., Palmeri, M. D. &amp; King, A. C. Acute alcohol response phenotype in heavy social drinkers is robust and reproducible. Alcohol. Clin. Exp. Res. 38, 844&#x2013;852 (2014).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR31\" id=\"ref-link-section-d337729415e922\" rel=\"nofollow noopener\" target=\"_blank\">31<\/a>.<\/p>\n<p>Alcohol biosensor<\/p>\n<p>The laboratory study used the BACtrack Skyn (BACtrack, San Francisco, CA, USA), a wrist-worn alcohol biosensor with a magnetic detachable band, a black external housing, a power button, and a small blue light that indicates whether the device is powered on (Fig.\u00a0<a data-track=\"click\" data-track-label=\"link\" data-track-action=\"figure anchor\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#Fig1\" rel=\"nofollow noopener\" target=\"_blank\">1<\/a>). On its underside, the device has a charging port and a protective sensor filter. Transdermal alcohol concentration (TAC) is measured by the device via an electrochemical fuel-cell that records micrograms of alcohol per liter of air (\u03bcg\/L)<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 32\" title=\"Campbell, A. S., Kim, J. &amp; Wang, J. Wearable electrochemical alcohol biosensors. Curr. Opin. Electrochem. 10, 126&#x2013;135 (2018).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR32\" id=\"ref-link-section-d337729415e936\" rel=\"nofollow noopener\" target=\"_blank\">32<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 33\" title=\"Wang, Y. et al. Wrist-worn alcohol biosensors: Applications and usability in behavioral research. Alcohol 92, 25&#x2013;34 (2021).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR33\" id=\"ref-link-section-d337729415e939\" rel=\"nofollow noopener\" target=\"_blank\">33<\/a>. For assessing non-wear, the Skyn measures body surface temperature (degrees Celsius; \u00b0C) and motion (acceleration in g-forces; g). The device records TAC, temperature, and motion every 20\u00a0s. To upload the data to cloud storage, a smartphone must be connected to the device via Bluetooth and the BACtrack Skyn application must be opened<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 10\" title=\"Gunn, R. L. et al. Use of the BACtrack Skyn alcohol biosensor: Practical applications for data collection and analysis. Addiction 118, 1586&#x2013;1595 (2023).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR10\" id=\"ref-link-section-d337729415e943\" rel=\"nofollow noopener\" target=\"_blank\">10<\/a>. Researchers can then download the raw data from BACtrack\u2019s online research portal. For more information on battery life and data storage, see the Alcohol Biosensor section in Study Two Methods.<\/p>\n<p>Fig. 1<a class=\"c-article-section__figure-link\" data-test=\"img-link\" data-track=\"click\" data-track-label=\"image\" data-track-action=\"view figure\" href=\"https:\/\/www.nature.com\/articles\/s41598-025-16640-y\/figures\/1\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" aria-describedby=\"Fig1\" src=\"https:\/\/www.newsbeep.com\/us\/wp-content\/uploads\/2025\/08\/41598_2025_16640_Fig1_HTML.png\" alt=\"figure 1\" loading=\"lazy\" width=\"685\" height=\"496\"\/><\/a><\/p>\n<p>BACtrack Skyn Alcohol Biosensor. The Skyn wrist-worn alcohol biosensor (BACtrack, San Francisco, CA, USA) includes a power button and power indicator light on its front. The other side of the device features a charging port and protective sensor filter. The device is equipped using a magnetic band.<\/p>\n<p>Biosensor protocol<\/p>\n<p>Biosensor data were collected during 33 alcohol sessions and 28 placebo sessions. At the start of the baseline timepoint, participants equipped the wrist-worn biosensor to their non-dominant hand. Four unique Skyn devices, all Model T15 with firmware 4.13.1, were used during the laboratory study. These devices recorded data for a range of 44.4 to 73.1\u00a0h, totaling 245.0\u00a0h of Skyn data.<\/p>\n<p>Ground truth non-wear<\/p>\n<p>There were two a priori determined non-wear intervals during each session at approximately 45\u00a0min and 180\u00a0min after the onset of beverage ingestion. At each of these intervals, the participant was instructed to remove the device and give it to the research assistant who placed it on a table for about 10\u201320\u00a0min. After this interval, the participant was asked to reapply the device to their wrist. At each instance of device removal and re-application, the research assistant simultaneously recorded the hour and minute to an online database<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 34\" title=\"Harris, P. A. et al. The REDCap consortium: Building an international community of software platform partners. J. Biomed. Inform. 95, 103208 (2019).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR34\" id=\"ref-link-section-d337729415e983\" rel=\"nofollow noopener\" target=\"_blank\">34<\/a>. Throughout the study, there was a total of 120 non-wear intervals. See Fig.\u00a0<a data-track=\"click\" data-track-label=\"link\" data-track-action=\"figure anchor\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#Fig2\" rel=\"nofollow noopener\" target=\"_blank\">2<\/a> (or Supplemental Fig. S1) for the device removal protocol and corresponding changes to temperature and motion.<\/p>\n<p>Fig. 2<a class=\"c-article-section__figure-link\" data-test=\"img-link\" data-track=\"click\" data-track-label=\"image\" data-track-action=\"view figure\" href=\"https:\/\/www.nature.com\/articles\/s41598-025-16640-y\/figures\/2\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" aria-describedby=\"Fig2\" src=\"https:\/\/www.newsbeep.com\/us\/wp-content\/uploads\/2025\/08\/41598_2025_16640_Fig2_HTML.png\" alt=\"figure 2\" loading=\"lazy\" width=\"685\" height=\"265\"\/><\/a><\/p>\n<p>Example of Laboratory Ground Truth Non-Wear. This plot illustrates one participant\u2019s temperature and motion data during the laboratory protocol. The data show a characteristic change following device removal and re-application for a single participant. Removal produces a downward slope in temperature and a ceasing of motion signals while re-application produces a sharp rise in temperature and scattering of motion signals. The red temperature values and orange motion values correspond to non-wear intervals. These intervals were determined in the laboratory, where research assistants recorded the timestamps upon device removal and re-application; these timestamps are indicated by the dashed vertical lines.<\/p>\n<p>Data were downloaded from the BACtrack research portal at one reading per minute (rather than one reading per 20\u00a0s) to simplify time-series interpretation and minimize data processing burden, consistent with prior work<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 3\" title=\"Didier, N. A., King, A. C., Polley, E. C. &amp; Fridberg, D. J. Signal processing and machine learning with transdermal alcohol concentration to predict natural environment alcohol consumption. Exp. Clin. Psychopharmacol. 32, 245&#x2013;254 (2024).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR3\" id=\"ref-link-section-d337729415e1010\" rel=\"nofollow noopener\" target=\"_blank\">3<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 4\" title=\"Fairbairn, C. E., Han, J., Caumiant, E. P., Benjamin, A. S. &amp; Bosch, N. A Wearable Alcohol biosensor: Exploring the accuracy of transdermal drinking detection. Drug Alcohol Depend. 112519 (2024) &#010;                  https:\/\/doi.org\/10.1016\/j.drugalcdep.2024.112519&#010;                  &#010;                .\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR4\" id=\"ref-link-section-d337729415e1013\" rel=\"nofollow noopener\" target=\"_blank\">4<\/a>. Using ground truth timestamps recorded by research assistants, every biosensor reading was labeled \u201cworn\u201d or \u201cnot worn\u201d. Per session, based on ground truth labels, the device was worn for an average (\u00b1\u2009standard deviation) of 189.9\u2009\u00b1\u200920.0\u00a0min and not worn for 51.1\u2009\u00b1\u200913.3\u00a0min. Variation in wear and non-wear durations was due to varying rates of timepoint completion and minor procedural deviations (two sessions missed the first scheduled removal and nine sessions included removal at the end rather than the start of the 180-min timepoint). These deviations proved to be minimally consequential, as timestamps of non-wear intervals were still recorded and used to label ground truth for these sessions, resulting in more robust training data via increased variability of non-wear intervals.<\/p>\n<p>Algorithm developmentAlgorithm features<\/p>\n<p>A random forest algorithm<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 35\" title=\"Breiman, L. Random forests. Mach. Learn. 45, 5&#x2013;32 (2001).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR35\" id=\"ref-link-section-d337729415e1030\" rel=\"nofollow noopener\" target=\"_blank\">35<\/a> was trained to differentiate between \u201cworn\u201d and \u201cnot worn\u201d using temperature and motion recorded by the Skyn, as well as 20 additional features computed from temperature and motion: the difference between the current reading and the prior reading (prior change) and the difference between the current reading and the subsequent reading (subsequent change); the difference between the current reading and the mean of the 10 preceding readings (prior mean change) and the difference between the current reading and the mean of the 10 succeeding readings (subsequent mean change); the quadratic coefficients of the 10 preceding readings and the 10 succeeding readings (i.e., the curvature (a), slope (b), and intercept (c) of y\u2009=\u2009ax2\u2009+\u2009bx\u2009+\u2009c, where x is minutes relative to current timestamp and y is either temperature or motion). In total, the algorithm used 22 continuous features (Table <a data-track=\"click\" data-track-label=\"link\" data-track-action=\"table anchor\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#Tab2\" rel=\"nofollow noopener\" target=\"_blank\">2<\/a>).<\/p>\n<p>Table 2 Feature importance rankings of the random forest algorithm.<\/p>\n<p>Because time-series features depended on nearby values for their computation, time-series features were not computed when there were 5 or fewer available nearby readings. Limited nearby readings occurred before and after the laboratory session when the device was powered off. To enable algorithm predictions beside intervals of missing data, we configured three additional random forests: (1)\u00a0a pre-gap algorithm built without subsequent features, designed to make predictions on data before an interval of missing data; (2)\u00a0a post-gap algorithm built without prior features, designed to make predictions on data after an interval of missing data; (3)\u00a0a between-gap algorithm built only with current temperature and motion, designed to make predictions on readings surrounded by missing data. The final non-wear algorithm defaults to the 22-feature random forest, but if certain features cannot be computed due to missing data, the algorithm will utilize predictions from the appropriate reduced-feature algorithm. To assess performance of the final combined algorithm, all available predictions from the 22-feature algorithm were used (which accounted for 99.1% of laboratory data) and predictions from the reduced-feature algorithms were used for the remaining 0.9%.<\/p>\n<p>Training<\/p>\n<p>Each random forest was trained using device-based cross-validation<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 36\" title=\"Stone, M. Cross-validatory choice and assessment of statistical predictions. J. R. Stat. Soc. Ser. B Methodol. 36, 111&#x2013;133 (1974).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR36\" id=\"ref-link-section-d337729415e1537\" rel=\"nofollow noopener\" target=\"_blank\">36<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 37\" title=\"Leinonen, T. et al. Empirical investigation of multi-source cross-validation in clinical ECG classification. Comput. Biol. Med. 183, 109271 (2024).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR37\" id=\"ref-link-section-d337729415e1540\" rel=\"nofollow noopener\" target=\"_blank\">37<\/a>, also called leave-source-out cross-validation. As there were four unique devices used throughout the laboratory study, the data were split four times such that, at each split, three devices\u2019 data were used for training and one device\u2019s data were reserved for testing. Device-based cross-validation was chosen to evaluate how well the algorithm generalized to discrete devices<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 37\" title=\"Leinonen, T. et al. Empirical investigation of multi-source cross-validation in clinical ECG classification. Comput. Biol. Med. 183, 109271 (2024).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR37\" id=\"ref-link-section-d337729415e1544\" rel=\"nofollow noopener\" target=\"_blank\">37<\/a> and to limit wasting data as in single-split approaches<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 38\" title=\"Steyerberg, E. W. Validation in prediction research: the waste by data splitting. J. Clin. Epidemiol. 103, 131&#x2013;133 (2018).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR38\" id=\"ref-link-section-d337729415e1548\" rel=\"nofollow noopener\" target=\"_blank\">38<\/a>. At the conclusion of the fourth split, each device had a turn being left out and every biosensor reading had a corresponding prediction of \u201cworn\u201d or \u201cnot worn\u201d. A probability threshold of 0.5 was used to classify wear and non-wear readings. For details on hyperparameter tuning, see Supplementary Table S1.<\/p>\n<p>Performance metrics<\/p>\n<p>Given the precedent set by prior non-wear algorithm research<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 17\" title=\"Skovgaard, E. L. et al. Generalizability and performance of methods to detect non-wear with free-living accelerometer recordings. Sci. Rep. 13, 2496 (2023).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR17\" id=\"ref-link-section-d337729415e1560\" rel=\"nofollow noopener\" target=\"_blank\">17<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 18\" title=\"Syed, S., Morseth, B., Hopstock, L. A. &amp; Horsch, A. A novel algorithm to detect non-wear time from raw accelerometer data using deep convolutional neural networks. Sci. Rep. 11, 8832 (2021).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR18\" id=\"ref-link-section-d337729415e1563\" rel=\"nofollow noopener\" target=\"_blank\">18<\/a>, non-wear was considered a positive classification. Therefore, correct predictions of non-wear were considered true positives, correct predictions of wear were considered true negatives, incorrect non-wear predictions were considered false positives, and incorrect wear predictions were considered false negatives. From these counts, sensitivity (proportion of detected non-wear), specificity (proportion of confirmed wear), and accuracy were calculated, as well as their 95% confidence intervals (CI) based on the Wilson score method. The area under the receiver operator curve (AUC-ROC) was also calculated. These metrics were calculated separately for each device and collectively for the entire dataset.<\/p>\n<p>Algorithm performance was compared to the predictive performance of five different temperature cutoffs (26, 27, 28, 29, and 30\u00a0\u00b0C), three of which (26, 28, and 29\u00a0\u00b0C) have been used in prior research to detect Skyn non-wear<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Courtney, J. B., Russell, M. A. &amp; Conroy, D. E. Acceptability and validity of using the BACtrack skyn wrist-worn transdermal alcohol concentration sensor to capture alcohol use across 28 days under naturalistic conditions&#x2014;A pilot study. Alcohol 108, 30&#x2013;43 (2023).\" href=\"#ref-CR2\" id=\"ref-link-section-d337729415e1570\">2<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" title=\"Didier, N. A., King, A. C., Polley, E. C. &amp; Fridberg, D. J. Signal processing and machine learning with transdermal alcohol concentration to predict natural environment alcohol consumption. Exp. Clin. Psychopharmacol. 32, 245&#x2013;254 (2024).\" href=\"#ref-CR3\" id=\"ref-link-section-d337729415e1570_1\">3<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 4\" title=\"Fairbairn, C. E., Han, J., Caumiant, E. P., Benjamin, A. S. &amp; Bosch, N. A Wearable Alcohol biosensor: Exploring the accuracy of transdermal drinking detection. Drug Alcohol Depend. 112519 (2024) &#010;                  https:\/\/doi.org\/10.1016\/j.drugalcdep.2024.112519&#010;                  &#010;                .\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR4\" id=\"ref-link-section-d337729415e1573\" rel=\"nofollow noopener\" target=\"_blank\">4<\/a>. For each cutoff, biosensor readings above or equal to the cutoff were labeled \u201cworn\u201d and readings below the cutoffs were labeled \u201cnot worn\u201d. True positives, true negatives, false positives, false negatives, sensitivity, specificity, and accuracy were calculated for each temperature cutoff.<\/p>\n<p>Feature importance<\/p>\n<p>Mean decrease in impurity (MDI) and split selection percentage were calculated for each of the features in the complete 22-feature random forest. MDI provides an indication of relative importance toward predictive accuracy, with larger values indicating greater ability to differentiate wear versus non-wear<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 35\" title=\"Breiman, L. Random forests. Mach. Learn. 45, 5&#x2013;32 (2001).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR35\" id=\"ref-link-section-d337729415e1585\" rel=\"nofollow noopener\" target=\"_blank\">35<\/a>,<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 39\" title=\"Pedregosa, F. et al. Scikit-learn: Machine learning in python. J. Mach. Learn. Res. 12, 2825&#x2013;2830 (2011).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR39\" id=\"ref-link-section-d337729415e1588\" rel=\"nofollow noopener\" target=\"_blank\">39<\/a>. Split selection percentage represents the proportion of all decision splits that incorporated a particular feature. More information on MDI and split selection is provided in Supplementary Table S2.<\/p>\n<p>Code<\/p>\n<p>Data processing and machine learning software was built using the Scikit-learn<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 39\" title=\"Pedregosa, F. et al. Scikit-learn: Machine learning in python. J. Mach. Learn. Res. 12, 2825&#x2013;2830 (2011).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR39\" id=\"ref-link-section-d337729415e1601\" rel=\"nofollow noopener\" target=\"_blank\">39<\/a> and Pandas<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 40\" title=\"McKinney, W. Data structures for statistical computing in python. in 56&#x2013;61 (Austin, Texas, 2010). &#010;                  https:\/\/doi.org\/10.25080\/Majora-92bf1922-00a&#010;                  &#010;                .\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR40\" id=\"ref-link-section-d337729415e1605\" rel=\"nofollow noopener\" target=\"_blank\">40<\/a> modules in Python. The trained algorithm and temperature cutoffs have been added to the Skyn Data Manager<a data-track=\"click\" data-track-action=\"reference anchor\" data-track-label=\"link\" data-test=\"citation-ref\" aria-label=\"Reference 3\" title=\"Didier, N. A., King, A. C., Polley, E. C. &amp; Fridberg, D. J. Signal processing and machine learning with transdermal alcohol concentration to predict natural environment alcohol consumption. Exp. Clin. Psychopharmacol. 32, 245&#x2013;254 (2024).\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#ref-CR3\" id=\"ref-link-section-d337729415e1609\" rel=\"nofollow noopener\" target=\"_blank\">3<\/a> as optional strategies for flagging non-wear. To replicate algorithm development, see repository here: <a href=\"https:\/\/zenodo.org\/records\/16914785\" rel=\"nofollow noopener\" target=\"_blank\">https:\/\/zenodo.org\/records\/16914785<\/a>. For the complete Skyn Data Manager software, access may be granted upon request to the corresponding author.<\/p>\n<p>Results: laboratory studySample<\/p>\n<p>The laboratory sample consisted of 36 individuals (18, 50.0% female) with an average age of 50.6\u00a0years. Participants were mostly White (n\u2009=\u200931, 86.1%) and consumed an average of 16.4 drinks per week (Table <a data-track=\"click\" data-track-label=\"link\" data-track-action=\"table anchor\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#Tab1\" rel=\"nofollow noopener\" target=\"_blank\">1<\/a>).<\/p>\n<p>Temperature and motion descriptives<\/p>\n<p>Throughout the laboratory study, temperature ranged from 20.6\u00a0\u00b0C to 36.5\u00a0\u00b0C and motion ranged from 0.004\u00a0g to 0.98\u00a0g. Based on laboratory ground truth, the average (\u00b1\u2009standard deviation) temperature and motion were, respectively, 31.2\u2009\u00b1\u20091.7\u00a0\u00b0C and 0.11\u2009\u00b1\u20090.14\u00a0g while the device was worn, compared to 25.7\u2009\u00b1\u20092.5\u00a0\u00b0C and 0.02\u2009\u00b1\u20090.04\u00a0g while it was not worn.<\/p>\n<p>Temperature cutoff performance<\/p>\n<p>For temperature cutoff predictions in the laboratory, the greatest sensitivity (\u00b1\u200995% CI) to detect non-wear occurred at the 30\u00a0\u00b0C cutoff (0.934\u2009\u00b1\u20090.009 CI), but this cutoff had the least specificity to confirm when the device was worn (0.774\u2009\u00b1\u20090.008 CI). Conversely, the greatest specificity to confirm when the device was worn occurred at the 25\u00a0\u00b0C cutoff (0.994\u2009\u00b1\u20090.001), but this cutoff had the worst sensitivity to detect non-wear (0.463\u2009\u00b1\u20090.018). The temperature cutoff of 28\u00a0\u00b0C had the highest accuracy of all temperature cutoffs (0.940\u2009\u00b1\u20090.004), showing strong specificity (0.974\u2009\u00b1\u20090.003) while also retaining moderate sensitivity to detect non-wear (0.815\u2009\u00b1\u20090.014).<\/p>\n<p>Algorithm performance<\/p>\n<p>As hypothesized, the algorithm performed with greater specificity and greater sensitivity than each temperature cutoff (Fig.\u00a0<a data-track=\"click\" data-track-label=\"link\" data-track-action=\"figure anchor\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#Fig3\" rel=\"nofollow noopener\" target=\"_blank\">3<\/a>). Across the four devices used for laboratory testing, sensitivities ranged from 0.917\u20130.978, specificities ranged from 0.989\u20130.999, and AUC-ROCs ranged from 0.998\u20130.999 (Table <a data-track=\"click\" data-track-label=\"link\" data-track-action=\"table anchor\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#Tab3\" rel=\"nofollow noopener\" target=\"_blank\">3<\/a>). Overall, the algorithm demonstrated high sensitivity to detect non-wear (0.960\u2009\u00b1\u20090.007) and high specificity to detect when the device was worn (0.995\u2009\u00b1\u20090.001), with an AUC-ROC of 0.999.<\/p>\n<p>Fig. 3<a class=\"c-article-section__figure-link\" data-test=\"img-link\" data-track=\"click\" data-track-label=\"image\" data-track-action=\"view figure\" href=\"https:\/\/www.nature.com\/articles\/s41598-025-16640-y\/figures\/3\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" aria-describedby=\"Fig3\" src=\"https:\/\/www.newsbeep.com\/us\/wp-content\/uploads\/2025\/08\/41598_2025_16640_Fig3_HTML.png\" alt=\"figure 3\" loading=\"lazy\" width=\"685\" height=\"335\"\/><\/a><\/p>\n<p>Laboratory Comparison of Non-Wear Detection Methods. Bar plots of sensitivity, specificity, and accuracy across the various temperature cutoffs (25\u201330 Celsius) and the trained algorithm. The algorithm outperformed the temperature cutoffs on each performance metric.<\/p>\n<p>Table 3 Non-wear algorithm performance with laboratory ground truth data.<\/p>\n<p>Out of the 120 device removals throughout the laboratory study, 119 had at least one concurrent non-wear prediction (i.e., only one removal went entirely undetected). Out of 245.0\u00a0h of laboratory data, there were 101 discrete intervals of incorrect predictions, with the average duration being 2.4\u00a0min and the longest interval being 24\u00a0min. See Supplementary Materials for additional plots (Fig. S2) and results (Tables S3 and S4).<\/p>\n<p>Algorithm feature importance<\/p>\n<p>Out of the 22 algorithm features (Table <a data-track=\"click\" data-track-label=\"link\" data-track-action=\"table anchor\" href=\"http:\/\/www.nature.com\/articles\/s41598-025-16640-y#Tab2\" rel=\"nofollow noopener\" target=\"_blank\">2<\/a>), the four most important were subsequent temperature intercept (MDI\u2009=\u20090.249), temperature (MDI\u2009=\u20090.219), prior mean temperature change (MDI\u2009=\u20090.111), and preceding temperature intercept (MDI\u2009=\u20090.088). While motion features were less important overall than temperature features, motion (MDI\u2009=\u20090.030) was ranked eighth most important. Across all features, split selection percentages ranged from 2.75% to 6.99%. For more results on feature importance, see Supplementary Table S2.<\/p>\n","protected":false},"excerpt":{"rendered":"Methods: laboratory studyParticipants Biosensor readings were collected during laboratory sessions from 36 participants (Table 1) enrolled in a&hellip;\n","protected":false},"author":2,"featured_media":107715,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[45],"tags":[70979,182,70976,181,507,244,50986,18665,1159,70977,1877,1160,70978,70975,79,7271,74],"class_list":["post-107714","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-adherence","tag-ai","tag-alcohol-biosensors","tag-artificial-intelligence","tag-artificialintelligence","tag-biotechnology","tag-data-acquisition","tag-human-behaviour","tag-humanities-and-social-sciences","tag-laboratory-ground-truth","tag-machine-learning","tag-multidisciplinary","tag-non-wear","tag-predictive-markers","tag-science","tag-software","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/107714","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=107714"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/107714\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/107715"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=107714"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=107714"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=107714"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}