Advances in infrared (IR) spectroscopic imaging instrumentation and data science now present unique opportunities for large validation studies of the concept of histopathology using spectral data. In this study, we examine the discrimination potential of IR metrics for different histologic classes to estimate the sample size needed for designing validation studies to achieve a given statistical power and statistical significance. Next, we present an automated annotation transfer tool that can allow large-scale training/validation, overcoming the limitations of sparse ground truth data with current manual approaches by providing a tool to transfer pathologist annotations from stained images to IR images across diagnostic categories. Finally, the results of a combination of supervised and unsupervised analysis provide a scheme to identify diagnostic groups/patterns and isolating pure chemical pixels for each class to better train complex histopathological models. Together, these methods provide essential tools to take advantage of the emerging capabilities to record and utilize large spectroscopic imaging datasets.

Infrared (IR) spectroscopic imaging provides both morphologic and chemical detail; however, obtaining this extensive spectral-spatial information requires the ability to rapidly record high-quality data. Discrete frequency infrared (DFIR) imaging using a point scanning microscope strikes a balance between data quality and acquisition speed that, in principle, can further be aided by computational methods. Here, we report a deep learning-based framework to complement the process of data acquisition and information extraction. First, we introduce a convolutional neural network (CNN) to leverage both spatial and spectral information for segmenting data into informative sub-classes, which we call the IR-SEG network. We show that this framework increases accuracy by using approximately half of the features used in the typical pixel-wise classification of IR data. Second, we present a generative adversarial network (GAN)-based approach to reconstruct full data sets with low loss in the information from incomplete spatial and spectral data recording. Termed IR-REC, this approach is shown to speed up data acquisition by up to 20-fold for typical biomedical samples. In addition to enhancing the speed and quality of data, we also propose a method to utilize complementary morphologic detail to estimate the spatial details of a single band IR image beyond the diffraction limit. Finally, we discuss potential pitfalls and new opportunities that can be addressed by developing these methods further. Together, these deep learning techniques provide new capabilities for IR imaging to extract better quality information faster.

Infrared (IR) spectroscopic imaging instruments' performance can be characterized and optimized by an analysis of their limit of detection (LOD). Here we report a systematic analysis of the LOD for Fourier transform IR (FT-IR) and discrete frequency IR (DFIR) imaging spectrometers. In addition to traditional measurements of sample and blank data, we propose a decision theory perspective to pose the determination of LOD as a binary classification problem under different assumptions of noise uniformity and correlation. We also examine three spectral analysis approaches, namely, absorbance at a single frequency, average of absorbance over selected frequencies and total spectral distance - to suit instruments that acquire discrete or contiguous spectral bandwidths. The analysis is validated by refining the fabrication of a bovine serum albumin protein microarray to provide eight uniform spots from similar to 2.8 nL of solution for each concentration over a wide range (0.05-10 mg/mL). Using scanning parameters that are typical for each instrument, we estimate a LOD of 0.16 mg/mL and 0.12 mg/mL for widefield and line scanning FT-IR imaging systems, respectively, using the spectral distance approach, and 0.22 mg/mL and 0.15 mg/mL using an optimal set of discrete frequencies. As expected, averaging and the use of post-processing techniques such as minimum noise fraction transformation results in LODs as low as similar to 0.075 mg/mL that correspond to a spotted protein mass of similar to 112 fg/pixel. We emphasize that these measurements were conducted at typical imaging parameters for each instrument and can be improved using the usual trading rules of IR spectroscopy. This systematic analysis and methodology for determining the LOD can allow for quantitative measures of confidence in imaging an analyte's concentration and a basis for further improving IR imaging technology.

The structure and organization of a tumor and its microenvironment are often associated with cancer outcomes due to spatially varying molecular composition and signaling. A persistent challenge is to use this physical and chemical spatial organization to understand cancer progression. Here, we present a high-definition infrared imaging-based organizational measurement framework (INFORM) that leverages intrinsic chemical contrast of tissue to label unique components of the tumor and its microenvironment. Using objective and automated computational methods, further, we determine organization characteristics important for prediction. We show that the tumor spatial organization assessed with this framework is predictive of overall survival in colon cancer that adds to capability from clinical variables such as stage and grade, approximately doubling the risk of death in high-risk individuals. Our results open an all-digital avenue for measuring and studying the association between tumor spatial organization and disease progression. Copyright © 2021 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works. Distributed under a Creative Commons Attribution NonCommercial License 4.0 (CC BY-NC).

Vibrational circular dichroism (VCD) spectroscopy has emerged as a powerful platform to quantify chirality, a vital biological property that performs a pivotal role in the metabolism of life organisms. With a photoelastic modulator (PEM) integrated into an infrared spectrometer, the differential response of a sample to the direction of circularly polarized light can be used to infer conformation handedness. However, these optical components inherently exhibit chromatic behavior and are typically optimized at discrete spectral frequencies. Advancements of discrete frequency infrared (DFIR) spectroscopic microscopes in spectral image quality and data throughput are promising for use toward analytical VCD measurements. Utilizing the PEM advantages incorporated into a custom-built QCL microscope, we demonstrate a point scanning VCD instrument capable of acquiring spectra rapidly across all fingerprint region wavelengths in transmission configuration. Moreover, for the first time, we also demonstrate the VCD imaging performance of our instrument for site-specific chirality mapping of biological tissue samples. This study offers some insight into future possibilities of examining small, localized changes in tissue that have major implications for systemic diseases and their progression, while also laying the groundwork for additional modeling and validation in advancing the capability of VCD spectroscopy and imaging.

Precise freeform microchannels within an aqueous environment have several biomedical applications but remain a challenge to fabricate. Carbohydrate glass materials have shown potential for three-dimensionally (3D) printing precise, microscale structures and are suitable as a sacrificial material to reconstruct complex channel architectures, but due to the rapid dissolution kinetics in hydrogels and the aqueous environment, protective coatings are required. Here, conformal coatings were applied to carbohydrate structures via surface-initiated photo-polymerization (SIP) by incorporating a photoinitiator (PI) into freeform 3D printed isomalt structures using a custom 3D printer. Structures were then immersed into a photocurable prepolymer bath and exposed to light for reaction initiation. To achieve uniform distribution of photoinitiator molecules in 3D printed constructs, miscibility between commercial photoinitiators and isomalt was modeled using the group contribution method. A dye-based, type-two photoinitiator, Eosin Y disodium salt (EY), was selected for its miscibility with isomalt and stability under high temperature. A previously described Eosin Y (EY)/triethanolamine (TEA) radical polymerization system was used to polymerize poly(ethylene glycol) diacrylate (PEGDA). Attenuated total reflectance-Fourier transform infrared (ATR-FTIR), surface morphology, and swelling ratio characterizations via SIP were performed. Coatings around freeform structures and solid surfaces were presented to demonstrate the capability of coating complex architectures. This coating method should facilitate the application of 3D sacrificial molding in a variety of hydrogels toward building biomimetic vascular constructs.

Molecular analysis techniques such as gene expression analysis and proteomics have contributed greatly to our understanding of cancer heterogeneity. In prior studies, gene expression analysis was shown to stratify patient outcome on the basis of tumor-microenvironment associated genes. A specific gene expression profile, referred to as ECM3 (Extracellular Matrix Cluster 3), indicated poorer survival in patients with grade III tumors. In this work, we aimed to visualize the downstream effects of this gene expression profile onto the tissue, thus providing a spatial context to altered gene expression profiles. Using infrared spectroscopic imaging, we identified spectral patterns specific to the ECM3 gene expression profile, achieving a high spectral classification performance of 0.87 as measured by the area under the curve of the receiver operating characteristic curve. On a patient level, we correctly identified 20 out of 22 ECM3 group patients and 19 out of 20 non-ECM3 group patients by using this spectroscopic imaging-based classifier. By comparing pixels that were identified as ECM3 or non-ECM3 with H&E and IHC images, we were also able to observe an association between tissue morphology and the gene expression clusters, showing the ability of our method to capture broad outcome associated features from infrared images.

Optical microscopy for biomedical samples requires expertise in staining to visualize structure and composition. Midinfrared (mid-IR) spectroscopic imaging offers label-free molecular recording and virtual staining by probing fundamental vibrational modes of molecular components. This quantitative signal can be combined with machine learning to enable microscopy in diverse fields from cancer diagnoses to forensics. However, absorption of IR light by common optical imaging components makes mid-IR light incompatible with modern optical microscopy and almost all biomedical research and clinical workflows. Here we conceptualize an IR-optical hybrid (IR-OH) approach that sensitively measures molecular composition based on an optical microscope with wide-field interferometric detection of absorption-induced sample expansion. We demonstrate that IR-OH exceeds state-of-the-art IR microscopy in coverage (10-fold), spatial resolution (fourfold), and spectral consistency (by mitigating the effects of scattering). The combined impact of these advances allows full slide infrared absorption images of unstained breast tissue sections on a visible microscope platform. We further show that automated histopathologic segmentation and generation of computationally stained (stainless) images is possible, resolving morphological features in both color and spatial detail comparable to current pathology protocols but without stains or human interpretation. IR-OH is compatible with clinical and research pathology practice and could make for a cost-effective alternative to conventional stain-based protocols for stainless, all-digital pathology.

Current histopathological diagnosis involves human expert interpretation of stained images for diagnosis. This process is prone to inter-observer variability, often leading to low concordance rates amongst pathologists across many types of tissues. Further, since structural features are mostly just defined for epithelial alterations during tumor progression, the use of associated stromal changes is limited. Here we sought to examine whether digital analysis of commonly used hematoxylin and eosin-stained images could provide precise and quantitative metrics of disease from both epithelial and stromal cells. We developed a convolutional neural network approach to identify epithelial breast cells from their microenvironment. Second, we analyzed the microenvironment to further observe different constituent cells using unsupervised clustering. Finally, we categorized breast cancer by the combined effects of stromal and epithelial inertia. Together, the work provides insight and evidence of cancer association for interpretable features from deep learning methods that provide new opportunities for comprehensive analysis of standard pathology images. © Copyright © 2019 Mittal, Stoean, Kajdacsy-Balla and Bhargava.