Patent Publication Number: US-2017363633-A1

Title: Methods for diagnosis, prognosis and methods of treatment

Description:
CROSS-REFERENCE 
     This application is a continuation application of U.S. patent application Ser. No. 14/843,801, filed Sep. 2, 2015, which is a continuation-in-part application of U.S. patent application Ser. No. 13/566,991, filed Aug. 3, 2012, which claims the benefit of U.S. Provisional Patent Application Ser. No. 61/664,426, filed Jun. 26, 2012, U.S. Provisional Patent Application Ser. No. 61/515,660, filed Aug. 5, 2011, U.S. Provisional Patent Application Ser. No. 61/558,343, filed Nov. 10, 2011 and U.S. Provisional Patent Application Ser. No. 61/565,391, filed Nov. 30, 2011, each of which is incorporated herein by reference in ites entirety. U.S. patent application Ser. No. 14/843,801, filed Sep. 2, 2015, also claims the benefit of U.S. Provisional Patent Application No. 62/044,995, filed Sep. 2, 2014, which application is incorporated herein by reference in its entirety. 
    
    
     STATEMENT AS TO FEDERALLY SPONSORED RESEARCH 
     This invention was made with government support under PHS Cooperative Agreement grant numbers awarded by the National Cancer Institute, DHHS: CA32102, CA38926, CA12213, CA20319, CA14958, CA49883, CA17145 and CA21115. The government has certain rights in the invention. 
    
    
     BACKGROUND OF THE INVENTION 
     Many conditions are characterized by disruptions in cellular pathways that lead, for example, to aberrant control of cellular processes, with uncontrolled growth and increased cell survival. These disruptions are often caused by changes in the activity of molecules participating in cellular pathways. For example, alterations in specific signaling pathways have been described for many cancers. Despite the increasing evidence that disruption in cellular pathways mediate the detrimental transformation, the precise molecular events underlying these transformations in diseases remain unclear. As a result, therapeutics may not be effective in treating conditions involving cellular pathways that are not well understood. Thus, the successful diagnosis of a condition and use of therapies will require knowledge of the cellular events that are responsible for the condition pathology. 
     Acute myeloid leukemia (AML), myelodysplastic syndrome (MDS), and myeloproliferative neoplasms (MPN) are examples of disorders that arise from defects of hematopoietic cells of myeloid origin. These hematopoietic disorders are recognized as clonal diseases, which are initiated by somatic and/or inherited mutations that cause dysregulated signaling in a progenitor cell. The wide range of possible mutations and accompanying signaling defects accounts for the diversity of disease phenotypes and response to therapy observed within this group of disorders. For example, some leukemia patients respond well to treatment and survive for prolonged periods, while others die rapidly despite aggressive treatment. Some patients with myelodysplastic syndrome suffer only from anemia while others transform to an acute myeloid leukemia that is difficult to treat. Despite the emergence of new therapies to treat these disorders the percentage of patients who do not benefit from current treatment is still high. Patients that are resistant to therapy experience significant toxicity and have very short survival times. While various staging systems have been developed to address this clinical heterogeneity, they cannot accurately predict at diagnosis the prognosis or predict response to a given therapy or the clinical course that a given patient will follow. 
     Accordingly, there is a need for a biologically based clinically relevant re-classification of these disorders that can inform on disease management at the individual level. This classification, based upon the biologic commonalities of the disorders above, will aid clinicians in both prognosis and therapeutic selection at the individual patient level thus improving patient outcomes e.g. survival and quality of life. 
     There are also needs for a biologically based clinically relevant re-classification of these disorders to aid in new drug target identification and drug screening for agents that may be active against myeloid malignancies. 
     In “elderly” AML populations (typically defined by age &gt;55 or &gt;65 years), the complete remission (CR) rate in response to standard-dose cytarabine (Ara-C)-based induction chemotherapy ranges from 35 to 50% depending on the study, while the rate of treatment-related mortality (TRM) ranges from 15-20%. Other induction-therapy options for elderly AML patients, including high-dose Ara-C, high-dose daunorubicin, hypomethylating agents or other investigational agents have been shown to increase the rate of CR to 40-50%. The ability to distinguish patients likely to benefit from standard induction therapy from those likely to fail such therapy would be a significant contribution to patient management, by allowing patients to avoid harmful treatment that is likely to be futile, perhaps in favor of enrollment in clinical trials evaluating new targeted and less intensive regimens as first line treatment. Considerable effort has gone into creating models based on clinical parameters, cytogenetics and molecular testing to predict response. Technologies such as FISH and rapid molecular testing aim at making established diagnostic methods (such as cytogenetics and detection of leukemogenic mutations) which can assist in the risk classification and prognostication of AML available to patients earlier in the diagnostic process. However, in community practice and non-academic treatment centers where a considerable proportion of elderly AML patients are treated, cytogenetic and molecular test results are not always available at the time of the initiation of induction therapy due to a longer turn-around time between sample acquisition and availability of results. 
     SUMMARY OF THE INVENTION 
     One embodiment disclosed herein is a method of diagnosing, prognosing, determining progression, predicting a response to a treatment or choosing a treatment for pediatric acute myeloid leukemia (AML) in an individual. The method comprises (1) classifying one or more AML cells in an individual younger than 21 years old by: a) subjecting a cell population comprising said one or more AML cells from said individual to a modulator selected from the group consisting of Etoposide, Thapsigargin, or FLT3L; b) determining an activation level of p-Erk or p-S6 in one or more cells from said individual, c) determining the level of cleaved PARP in the one or more cells; and c) classifying said one or more hematopoietic cells based on said activation levels of p-Erk and S6 and the level of cleaved PARP; and (2) making a decision regarding a diagnosis, prognosis, progression, response to a treatment, selection of treatment or risk of relapse in said individual based on said classification of said one or more AML cells. The determining steps can be performed using a flow cytometer or a mass spectrometer. 
     One embodiment shown herein is a method for prognosing, predicting, or monitoring disease states in single cells, comprising: determining the level of an activatable element in cells in a sample on a single cell basis; classifying the cells in the sample as mature or immature; excluding cells from further analysis that are classified as mature and limiting further analysis to only those cells that are classified as immature; and correlating the activation level of the activatable elements to levels of activatable elements for disease profiles. The method can use extracellular markers such as CD11b, CD117, CD45 and CD34 to determine maturity of the cells. The method can also limit the analysis to those cells that are not in active apoptosis. The method can also use a FAB classification to determine maturity of the cells, such as M0, M1, M2 and M6. The analysis can be performed on bone marrow cells, single cells, and pathways, such as apoptosis and DNA damage repair. One embodiment can determine response to therapy, non-response, or risk of relapse. 
     One embodiment discloses multiple methods to analyze the data received from the above method. 
     In certain embodiments, the invention provides a method of treating an individual suffering from AML, wherein the individual is greater than 55 years old, comprising administering araC to the individual based on a decision to treat the individual, wherein the decision to treat the individual is based at least in part on the results of a test comprising (i) contacting cells from a sample from the individual with one or more agents that induce apoptosis; (ii) determining the level of apoptosis in the cells by a process that comprises determining, in single cells, the level of a marker of apoptosis. In certain embodiments, the marker of apoptosis comprises a marker selected from the group consisting of pChk2, p-H2AX, Bcl-2, cytochrome c, c-caspase 3, c-caspase 8, and cPARP, for example, cPARP. The test can further include determining the level of a second marker in the single cells, such as a marker of cell maturity, e.g., CD34. The level of the marker of apoptosis can be adjusted by a first factor and the level of the second marker can be adjusted by a second factor, where the first factor is at least 1.5 times greater than the second factor. The level of the marker or markers can be determined by a process comprising (a) contacting the single cells with a detectable binding element specific for the marker; (b) detecting the detectable binding element in the single cells with a detector. The detectable element can be an antibody or antibody fragment. The detector comprises can be a flow cytometer. The detector can be a mass cytometer. The test can comprise gating the cells from the sample so that results from a subset of cells are used in the decision. The gating can be by one or more of side scatter (SSC) and forward scatter (FSC), Amine Aqua or other indicator of cell death and SSC, SSC and CD45. In certain embodiments, the gating is by at least two of side scatter (SSC) and forward scatter (FSC), Amine Aqua or other indicator of cell death and SSC, SSC and CD45. In certain embodiments, the gating is by three of side scatter (SSC) and forward scatter (FSC), Amine Aqua or other indicator of cell death and SSC, SSC and CD45. In certain embodiments, cells are first gated by side scatter and forward scatter (SSC and FSC) to eliminate cell debris, then by Amine Aqua or other indicator of cell death and SSC to eliminate dead cells, then by SSC and CD45 to select for blasts, and finally measures of the marker of apoptosis are taken. The test can further comprise contacting cells from a sample from the individual with a modulator that is not an agent that induces apoptosis and determining, in single cells, the levels of an intracellular activatable element. The modulator can be selected from the group consisting of FLT3L, PMA, SCF, IL-27, G-CSF, etoposide, and thapsigargin, such as selected from the group consisting of FT3L and PMA. The intracellular activatable element can be selected from the group consisting of pAKT, pCREB, p-ERK, p-S6, p-STAT1, p-STAT3, p-STAT5, such as selected from the group consisting of pAKT and pCREB. In certain embodiments, the agents that induce apoptosis comprise etoposide, araC, or daunorubicin, or a combination thereof. In certain embodiments at least two agents are used, such as araC and daunorubicin. In certain embodiments, the individual is further treated with an agent selected from the group consisting of daunorubicin, G-CSF, GM-CSF, cyclosporine, idarubicin, mitoxantrone, and combinations thereof. In certain embodiments, the decision to treat the individual is further based one or more of age, sex, race, absolute blast count, percent of blasts, monocytes, neutrophils, FLT3 ITD status, NPM1 status, hemoglobin, platelet count, or a combination thereof. In certain embodiments, the sample is a bone marrow (BM) sample or a peripheral blood (PB) sample. In certain embodiments, the sample is a BM sample. In certain embodiments, the individual is suffering from de novo AML or secondary AML. In certain embodiments, the individual is suffering from de novo AML. In certain embodiments, the test further comprises determining the viability of the cells and proceeding with the test only if the viability exceeds a certain threshold. In certain embodiments, determining the viability of the cells comprises measuring, in single cells, the levels of one or more markers of apoptosis and comparing the level to the threshold level. The marker of apoptosis can comprise cPARP. 
     In certain embodiments the invention provides kit for determining whether or not to treat an individual greater than 55 years of age suffering from AML with a treatment comprising administering araC to the individual, comprising (i) at least two agents that induce apoptosis, selected from the group consisting of etoposide, araC, and daunorubicin; (ii) a detectable binding element for detecting a marker of apoptosis selected from the group consisting of pChk2, p-H2AX, Bcl-2, cytochrome c, c-caspase 3, c-caspase 8, and cPARP; (iii) at least two detectable binding elements that bind to cell surface markers; (iv) instructions for use, wherein the instructions for use may be physically included with the other elements of the kit or may be supplied separately for use with the kit by electronic or physical delivery to an end user of the kit. The agents can comprise araC and daunorubicin. The detectable binding element can comprises an antibody or antibody fragment. The cell surface markers can comprise CD45 and CD34. The marker of apoptosis can be cPARP. The kit can further comprise suitable packaging. The kit can further comprise at least one, or at least two, or at least three, control cell lines. The kit can further comprise a set of rainbow control particles (RCPs). 
     INCORPORATION BY REFERENCE 
     All publications, patents, and patent applications mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent, or patent application was specifically and individually indicated to be incorporated by reference. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
       The novel features of the invention are set forth with particularity in the appended claims. A better understanding of the features and advantages of the present invention will be obtained by reference to the following detailed description that sets forth illustrative embodiments, in which the principles of the invention are utilized, and the accompanying drawings of which: 
         FIG. 1  shows some examples of cellular pathways. For example, cytokines such as G-CSF or growth factors such as FLT-3 Ligand (FLT3L) will activate their receptors resulting in activation of intracellular signaling pathways. Also, chemotherapeutics, such as AraC can be transported inside the cell to cause effects, such as DNA damage, caspase activation, PARP cleavage, etc. 
         FIG. 2A  shows the use of four metrics used to analyze data from cells that may be subject to a disease, such as AML. For these metrics the median (mean can be used as well) fluorescence intensity (MFI) was computed for the cells in one of the gated populations measured under various conditions of staining and stimulation. For example, the “basal” metric is calculated by subtracting the MFI of cells in the absence of a stimulant and stain (autofluorescence) from the MFI for cell measured in the absence of a stimulant (autofluorescence) (log 2 (MFI Unstimulated Stained )−log 2 (MFI Gated Unstained ). The “total phospho” metric is calculated by measuring the fluorescence of a cell that has been stimulated with a modulator and stained with a labeled antibody and then subtracting the value for autofluorescence (log 2 (MFI Stimulated Stained )−log 2 (MFI Gated Unstained ). The “fold change” metric is the measurement of the fluorescence of a cell that has been stimulated with a modulator and stained with a labeled antibody and then subtracting the value for unstimulated stained cells (log 2 (MFI Stimulated Stained )−log 2 (MFI Unstimulated Stained ). The “quadrant frequency” metric is the percentage of cells in each quadrant of the contour plot.  FIG. 2B  shows that additional metrics can also be derived directly from the distribution of cell for a protein in a gated population for various conditions. NewlyPos=% of newly positive cells by modulator, based on a positive gate for a stain. AUC unstim=Area under the curve of frequency of un-modulated cells and modulated cells for a stain. NewlyPos: % Positive Cells modulated−% Positive Cellsunmodulated.  FIG. 2B  measures the frequency of cells with a described property such as cells positive for cleaved PARP (% PARP+), or cells positive for p-S6 and p-Akt. Similarly, measurements examining the changes in the frequencies of cells may be applied such as the Change in % PARP+which would measure the % PARP+ Stimulated Stained −% PARP+ Unstimulated Stained . The AUC unstim  metric also measures changes in population frequencies measuring the frequency of cells to become positive compared to an unstimulated condition. 
         FIG. 3  shows a diagram of apoptosis pathways. 
         FIG. 4  shows the use of signaling nodes to select patients for specific targeted therapies. 
         FIG. 5 : (a) depicts a gating analysis to define leukemic blast population. (b) shows that cell surface markers did not identify resistance-associated myeloblasts subpopulations. 
         FIG. 6  shows that an examination of signaling profiles revealed differences in relapse and diagnosis samples for SCF and FLT3L. 
         FIG. 7  shows that c-kit expression is not predictive of SCF responsiveness. 
         FIG. 8  shows univariate analysis for first study. Univariate analysis of modulated signaling and functional apoptosis nodes stratify NR and CR patient groups. (A) Stratification of NR and CR patient groups with SCF modulated, but not Basal, p-Akt signaling. (B) Stratification of NR and CR patients using functional apoptosis assays. The frequency of p-CHK2−, Cleaved PARP+ (c-PARP+) Apoptotic cells (upper left quadrant of the flow cytometry plots) after overnight exposure to Etoposide is used to quantify apoptosis. The circle in the lower right quadrant highlights cells that mount a DNA Damage Response but fail to undergo apoptosis 
         FIG. 9  shows combinations of independent nodes from distinct pathways improve stratification for first study. Examples demonstrate how corners and thresholds for the classifiers are set. (O: CR, X: NR) (A) Doublet combination of nodes i.e. SCF induced p-Erk and IL-27 induced p-Stat3. (B) Triplet combinations of nodes i.e. SDF-α induced p-Akt, IL-27 induced p-Stat3, and Etoposide induced p-CHK2-c PARP+ cells. C) Comparison of AUCs of ROCs of raw data vs. AUCs of ROCs on bootstrapped data to illustrate robustness of individual combinations. Combinations with AUCs of ROCs above 0.95 on the raw data are shown. 
         FIG. 10  contains “box and whisker” plots and scatter plots that illustrate the different ranges of signaling observed in FLT3-WT and BMMC cells. 
         FIG. 11  contains distribution plots that illustrate the different ranges of signaling observed in FLT3-WT and BMMC cells and distinct FLT3L responsive subpopulations in both sets of cells. 
         FIG. 12  illustrates FLT3L signaling kinetics in FLT3-WT AML and healthy bone marrow myeloblast (BMMC). 
         FIG. 13  depicts a table comparing FLT3 Receptor and FLT3L induced signaling between normal BM Myeloblast and FLT3-WT AML. 
         FIG. 14  depicts the variance in signaling among different FLT3 subgroups. 
         FIG. 15  contains “box and whisker” plots that demonstrate the range of values of both FLT3 receptor levels and FLT3L-induced S6 signaling. 
         FIG. 16  contains “box and whisker” plots that demonstrate the observed differences between FLT3-WT and FLT3-ITD samples. (a) illustrates differences in FLT3L-induced Stat signaling. (b) illustrates differences in IL-27-induced Stat signaling. (c) illustrates differences in Etoposide-induced apoptosis. 
         FIG. 17  graphically depicts stratifying nodes that distinguished FLT3-ITD from FLT3-WT samples. 
         FIG. 18  tabulates the correlations between nodes that stratify FLT3-ITD from FLT3-WT samples. 
         FIG. 19  provides a schematic overview of bivariate modeling. 
         FIG. 20  contains scatter plots that illustrate the signaling profiles of clinical outliers relative to other study samples. (A) illustrates FLT3L-induced S6 signaling in the clinical outliers relative to FLT3-ITD and FLT3-WT samples. (B) illustrates IL-27-induced Stat signaling in the clinical outliers relative to FLT3-ITD and FLT3-WT samples. (C) illustrates IL-27-induced Stat signaling in the clinical outliers relative to FLT3-ITD and FLT3-WT samples. 
         FIG. 21  tabulates the correlations between nodes that stratify FLT3-ITD from FLT3-WT samples. 
         FIG. 22  tabulates results from a univariate analysis of differences between FLT3-ITD and FLT3-WT signaling. 
         FIG. 23  depicts a summary table of common stratifying pathways between FLT3-WT and FLT3-ID signaling in AML samples. 
         FIG. 24  depicts FLT3L-induced p-S6, p-Erk and p-Akt signaling in different FLT3 subgroups. 
         FIG. 25  depicts IL-27-induced p-Stat1, p-Stat3 and p-Stat5 signaling in different FLT3 subgroups. 
         FIG. 26  tabulates results from a univariate analysis of differences between FLT3-ITD and FLT3-WT signaling. 
         FIG. 27  list all combinations of nodes for which the bivariate model of the combination had an AUC greater than the best single node/metric within the combination 
         FIG. 28  demonstrates the stratification that PCA achieves when applied to induced nodes in pathways and basal nodes in the same pathways. 
         FIG. 29  illustrates three distinct responses to apoptosis and DNA damage repair (DNA) that were observed in AML blasts. 
         FIGS. 30 : (a) is a scatter plot comparing etoposide versus staurosporine-mediated apoptosis. (b) contains distribution plots that illustrate sample-specific differences in sensitivity to etoposide and staurosporine-mediated apoptosis. 
         FIG. 31 : (A) illustrates the selection of staurosporine refractory and responsive cells. (B) contains scatter plots which illustrate IL-27-induced and G-CSF-induced Stat signaling responses in the staurosporine outliers. (C) contains scatter plots that compare a principle component representing Stat pathway activity (derived from PCA of the nodes associated Stat pathway). (D) tabulates the Pearson and Spearman correlations between staurosporine response and individual nodes. 
         FIG. 32 : (a) illustrates the selection of etoposide and staurosporine refractory and responsive cells. (b) contains scatter-plots which illustrate FLT3-induced and SCF-induced PI3K signaling response samples with high or low apoptosis responses to etoposide and staurosporine. (c) contains scatter-plots that compare a principle component representing PI3K pathway activity (derived from PCA of the nodes associated PI3K pathway). (d) tabulates the Pearson and Spearman correlations between staurosporine/etoposide response and individual nodes in the PI3K pathway. 
         FIG. 33 : (A) and (B) contain distribution plots that illustrate distinct subpopulations of AML samples and the differences in Etoposide, Staurosporine, FLT3L and G-CSF-induced signaling between the distinct subpopulations of AML. 
         FIG. 34  depicts a model score vs. the predicted probability for the BBLRS model on the training data (unadjusted). Both the true outcome and the predicted probability (along with 95% confidence limits) of Complete Response (CR) are shown on the y-axis. 
         FIG. 35  depicts FLT3 Ligand induced signaling of p-S6 at 5, 10, and 15 min time points in healthy bone marrow myeloblast (BM Mb, and leukemic blast from AML donors with or without FLT3-ITD mutation. 
         FIG. 36  tabulates a list of stratifying nodes. 
         FIG. 37  Characterization of biologic in vitro Ara-C/Dauno, GO, and SCF responses in primary AML samples. (A) indicates pPercent apoptosis induced by 24 h Ara-C/Dauno or 48 h GO treatment in: Adult (triangles) and Pediatric (crosses) peripheral blood (blue) and bone marrow (orange) AML samples. Arrows indicate pediatric samples resistant to Ara-C/Dauno and GO. (B) provides FACS plots of pediatric AML samples for SCF induced p-Akt vs. p-Erk or Ara-C/Dauno induced DNA damage (p-Chk2) vs. apoptosis (cleaved PARP). Quadrant frequencies are indicated. 
         FIG. 38  Characterization of biologic in vitro Clofarabine (CLO), Decitabine (DEC), and Azacitidine (AZA) responses in primary AML samples. (A) shows results by drug (left panels) or by patient samples (right panels). Metrics for DDR (Log 2Fold, upper plots) and induced apoptosis (lower plots) have been described previously [Rosen et al, PLos One. 2010; 5:e12405.]. DDR data is gated on live cleaved PARP −  blasts. (B) provides FACS plots showing DNA damage (pH2AX) and induced apoptosis (cleaved PARP+) of Ara-C/Dauno resistant pediatric AML samples incubated with CLO for 24 hours (left) or 48 hours (right). Quadrant frequencies are indicated. (C) provides FACS plots showing DNA damage (pH2AX) and induced apoptosis (cleaved PARP + ) of AML samples incubated with AZA or DEC for 48 hours. Quadrant frequencies are indicated. 
         FIG. 39  provides a diagram of the work flow in Single Cell Network Profiling (SCNP) Technology: Bone marrow or blood cells (1) are modulated, fixed and permeabilized (2), then stained with an antibody cocktail containing antibodies directed against both cell surface markers as well as post-translational modifications of intra-cellular proteins (3). Cells are acquired using, e.g., cytometry such as multiparametric flow cytometry or mass cytometry (4) thus allowing quantification of intracellular pathway activity in cell subsets identified by gating on lineage surface markers (5). Various metrics to quantify basal and induced signaling and to assess association with biologic and clinical outcomes are applied. 
         FIG. 40  shows a flow diagram for SWOG Patient Disposition, all patients enrolled onto the SWOG parent AML trials and rationale for exclusion of patients from the final analysis sets. Text boxes describe the characteristics of patients carried forward. 
         FIG. 41  shows a flow diagram for ECOG Patient Disposition, all patients enrolled onto the parent ECOG AML trials and rationale for exclusion of patients from the final analysis sets. Text boxes describe the characteristics of patients carried forward. 
         FIG. 42  shows a flowcart of the study design with descriptive schematics of the patient sets in the Training, Verification and Validation analysis sets. SWOG samples were randomized into a Training and a Validation Analysis set and were sorted by tissue type (PB or BM). An initial subset of classifiers was trained separately in PB and BM samples in the Training Analysis sets and then PB classifiers were applied to BM and BM classifiers were applied to PB. From this training process 5 candidate classifiers were selected and applied to the ECOG Verification Analysis set. The final SCNP classifier was further refined and applied to 1) ECOG Verification Analysis set, 2) SWOG BM Validation Analysis set and 3) SWOG PB Validation Analysis set. 
         FIG. 43  shows a schematic of the cell signaling pathways probed in the Training set. An SCNP node consists of the combination of a modulator and the corresponding intracellular readout. Modulators are shown outside the cell initiating signaling pathways that produce an intracellular proteomic response (readouts shown below the curve indicating cell membrane). 
         FIG. 44  is an illustration of gating to identify blast cell population and cPARP negative blast cells. Intact cells were identified using scatter. Amine Aqua was then used to identify viable cells. CD45 was then used to identify Blast Cells. In wells where short term signaling was assayed, the blast cells were gated using cPARP expression to identify healthy leukemic cells. 
         FIG. 45  shows prediction accuracy of DX SCNP  in various subgroups in the BM Validation Analysis Set. For age and WBC, the subgroups were defined by thresholding at the median value. For all samples cytogenetic risk was determined using NCCN 2013 guideline criteria. Similarly to what is done in clinical practice, patients with unknown cytogenetics were imputed as intermediate risk cytogenetics. The point estimate of accuracy measured by AUROC and confidence intervals (Delong method) are also shown. 
         FIG. 46  provides graphical depiction of a process for calculation of the node-metrics. 
         FIG. 47  shows optical path configuration of FACS Canto II cytometers, including filter sets. 
         FIGS. 48A-48B  show plates corresponding to functional readouts in signaling pathways including one row of cell line controls and 7 samples per plate. 
         FIGS. 48C-48D  show apoptosis plates (4-hour and 24-hour respectively) including one row of cell line controls and 14 donors per plate. 
         FIGS. 49A-49B  illustrate P1 gate and Healthy P1 gate. 
     
    
    
     DETAILED DESCRIPTION OF THE INVENTION 
     The present invention incorporates information disclosed in other applications and texts. The following patent and other publications are hereby incorporated by reference in their entireties: Haskell et al, Cancer Treatment, 5 th  Ed., W.B. Saunders and Co., 2001; Alberts et al., The Cell, 4 th  Ed., Garland Science, 2002; Vogelstein and Kinzler, The Genetic Basis of Human Cancer, 2d Ed., McGraw Hill, 2002; Michael, Biochemical Pathways, John Wiley and Sons, 1999; Weinberg, The Biology of Cancer, 2007; Immunobiology, Janeway et al. 7 th  Ed., Garland, and Leroith and Bondy, Growth Factors and Cytokines in Health and Disease, A Multi Volume Treatise, Volumes 1A and 1B, Growth Factors, 1996. Other conventional techniques and descriptions can be found in standard laboratory manuals such as Genome Analysis: A Laboratory Manual Series (Vols. I-IV), Using Antibodies: A Laboratory Manual, Cells: A Laboratory Manual, PCR Primer: A Laboratory Manual, and Molecular Cloning: A Laboratory Manual (all from Cold Spring Harbor Laboratory Press), Stryer, L. (1995) Biochemistry (4th Ed.) Freeman, New York, Gait, “Oligonucleotide Synthesis: A Practical Approach” 1984, IRL Press, London, Nelson and Cox (2000), Lehninger, Principles of Biochemistry 3rd Ed., W. H. Freeman Pub., New York, N.Y. and Berg et al. (2002) Biochemistry, 5th Ed., W. H. Freeman Pub., New York, N.Y.; and Sambrook, Fritsche and Maniatis. “Molecular Cloning A laboratory Manual” 3rd Ed. Cold Spring Harbor Press (2001), all of which are herein incorporated in their entirety by reference for all purposes. 
     Also, patents and applications that are incorporated by reference include U.S. Pat. Nos. 7,381,535, 7,393,656, 7,563,584, 7,695,924, 7,695,926, 7,939,278, 8,148,094, 8,187,885, 8,198,037, 8,206,939, 8,214,157, 8,227,202; U.S. patent applications Ser. Nos. 11/338,957, 11/655,789, 12/061,565, 12/125,759, 12/125,763, 12/229,476, 12/432,239, 12/432,720, 12/471,158, 12/501,274, 12/501,295, 12/538,643, 12/551,333, 12/581,536, 12/606,869, 12/617,438, 12/687,873, 12/688,851, 12/703,741, 12/713,165, 12/730,170, 12/778,847, 12/784,478, 12/877,998, 12/910,769, 13/082,306, 13/091,971, 13/094,731, 13/094,735, 13/094,737, 13/098,902, 13/098,923, 13/098,932, 13/098,939, 13/384,181; International Applications Nos. PCT/US2011/001565, PCT/US2011/065675, PCT/US2011/026117, PCT/US2011/029845, PCT/US2011/048332; and U.S. Provisional Applications Ser. Nos. 60/304,434, 60/310,141, 60/646,757, 60/787,908, 60/957,160, 61/048,657, 61/048,886, 61/048,920, 61/055,362, 61/079,537, 61/079,551, 61/079,579, 61/079,766, 61/085,789, 61/087,555, 61/104,666, 61/106,462, 61/108,803, 61/113,823, 61/120,320, 61/144,68, 61/144,955, 61/146,276, 61/151,387, 61/153,627, 61/155,373, 61/156,754, 61/157,900, 61/162,598, 61/162,673, 61/170,348, 61/176,420, 61/177,935, 61/181,211, 61/182,518, 61/182,638, 61/186,619, 61/216,825, 61/218,718, 61/226,878, 61/236,281, 61/240,193, 61/240,613, 61/241,773, 61/245,000, 61/254,131, 61/263,281, 61/265,585, 61/265,743, 61/306,665, 61/306,872, 61/307,829, 61/317,187, 61/327,347, 61/350,864, 61/353,155, 61/373,199, 61/374,613, 61/381,067, 61/382,793, 61/423,918, 61/436,534, 61/440,523, 61/469,812, 61/499,127, 61/515,660, 61/521,221, 61/542,910, 61/557,831, 61/558,343, 61/565,391, 61/565,929, 61/565,935, 61/591,122, 61/640,794, 61/658,092, 61/664,426. 
     Some commercial reagents, protocols, software and instruments that are useful in some embodiments of the present invention are available at the Becton Dickinson Website http(double slash)www.bdbiosciences.com(slash)features(slash)products(slash), and the Beckman Coulter website, http:(double slash)www.beckmancoulter.com(slash)Default.asp?bhfv=7. Relevant articles include High-content single-cell drug screening with phosphospecific flow cytometry, Krutzik et al., Nature Chemical Biology, 23 Dec. 2007; Irish et al., FLt3 ligand Y591 duplication and Bcl-2 over expression are detected in acute myeloid leukemia cells with high levels of phosphorylated wild-type p53, Neoplasia, 2007, Irish et al. Mapping normal and cancer cell signaling networks: towards single-cell proteomics, Nature, Vol. 6 146-155, 2006; Irish et al., Single cell profiling of potentiated phospho-protein networks in cancer cells, Cell, Vol. 118, 1-20 Jul. 23, 2004; Schulz, K. R., et al., Single-cell phospho-protein analysis by flow cytometry, Curr Protoc Immunol, 2007, 78:8 8.17.1-20; Krutzik, P. O., et al., Coordinate analysis of murine immune cell surface markers and intracellular phosphoproteins by flow cytometry, J Immunol. 2005 Aug. 15; 175(4):2357-65; Krutzik, P. O., et al., Characterization of the murine immunological signaling network with phosphospecific flow cytometry, J Immunol. 2005 Aug. 15; 175(4):2366-73; Shulz et al., Current Protocols in Immunology 2007, 78:8.17.1-20; Stelzer et al. Use of Multiparameter Flow Cytometry and Immunophenotyping for the Diagnosis and Classification of Acute Myeloid Leukemia, Immunophenotyping, Wiley, 2000; and Krutzik, P. O. and Nolan, G. P., Intracellular phospho-protein labeling techniques for flow cytometry: monitoring single cell signaling events, Cytometry A. 2003 October; 55(2):61-70; Hanahan D., Weinberg, The Hallmarks of Cancer, CELL, 2000 Jan. 7; 100(1) 57-70; and Krutzik et al, High content single cell drug screening with phosphospecific flow cytometry, Nat Chem Biol. 2008 February; 4(2):132-42. Experimental and process protocols and other helpful information can be found at http(slash)proteomics.stanford.edu. The articles and other references cited below are also incorporated by reference in their entireties for all purposes. More specific procedures can be found in the following manuscripts: Rosen D B, Putta S, Covey T et al. Distinct Patterns of DNA Damage Response and Apoptosis Correlate with Jak/Stat and PI3Kinase Response Profiles in Human Acute Myelogenous Leukemia. 2010. PLoS ONE. 5 (8): e12405; Kornblau S M, Minden M D, Rosen D B, Putta S, Cohen A, Covey T, et al., Dynamic Single-Cell Network Profiles in Acute Myelogenous Leukemia Are Associated with Patient Response to Standard Induction Therapy. 2010. Clinical Cancer Research. 16 (14): 3721-33 January 31; Rosen D B et al., Functional Characterization of FLT3 Receptor Signaling Deregulation in AML by Single Cell Network Profiling (SCNP). 2010. PLoS ONE. 5 (10): e13543. Covey T M, Putta S, Cesano A. Single cell network profiling (SCNP): mapping drug and target interactions. Assay Drug Dev Technol. 2010; 8:321-43. 
     One embodiment of the present invention involves the classification, diagnosis, prognosis of disease or outcome after administering a therapeutic to treat the disease; exemplary diseases include AML, MDS and MPN. Another embodiment of the invention involves monitoring and predicting outcome of disease. Another embodiment is drug screening using some of the methods of the invention, to determine which drugs may be useful in particular diseases. In other embodiments, the invention involves the identification of new druggable targets, that can be used alone or in combination with other treatments. The invention allows the selection of patients for specific target therapies. The invention allows for delineation of subpopulations of cells associated with a disease that are differentially susceptible to drugs or drug combinations. In another embodiment, the invention allows to demarcate subpopulations of cells associated with a disease that have different genetic subclone origins. In another embodiment, the invention provides for the identification of a cell type, that in combination with other cell type(s), provide ratiometric or metrics that singly or coordinately allow for surrogate identification of subpopulations of cells associated with a disease, diagnosis, prognosis, disease stage of the individual from which the cells were derived, response to treatment, risk of relapse, monitoring and predicting outcome of disease. Another embodiment involves the analysis of apoptosis, drug transport and/or drug metabolism. In performing these processes, one preferred analysis method involves looking at cell signals and/or expression markers. One embodiment of cell signal analysis involves the analysis of phosphorylated proteins and the use of flow cytometers or mass spectrometers in that analysis. In one embodiment, a signal transduction-based classification of AML can be performed using clustering of phospho-protein patterns or biosignatures. See generally  FIG. 1 . 
     In some embodiments, the present invention provides methods for classification, diagnosis, prognosis of disease and outcome after administering a therapeutic to treat the disease by characterizing a plurality of pathways in a population of cells. In some embodiments, a treatment is chosen based on the characterization of plurality of pathways in single cells. In some embodiments, characterizing a plurality of pathways in single cells comprises determining whether apoptosis pathways, cell cycle pathways, signaling pathways, or DNA damage pathways are functional in an individual based on the activation levels of activatable elements within the pathways, where a pathway is functional if it is permissive for a response to a treatment. For example, when the apoptosis, cell cycle, signaling, and DNA damage pathways are functional, the individual can respond to treatment, and when at least one of the pathways is not functional the individual can not respond to treatment. In some embodiments, if the apoptosis and DNA damage pathways are functional the individual can respond to treatment. 
     In some embodiments, the characterization of pathways in conditions such as AML, MDS and MPN shows disruptions in cellular pathways that are reflective of increased proliferation, increased survival, evasion of apoptosis, insensitivity to anti-growth signals and other mechanisms. In some embodiments, the disruption in these pathways can be revealed by exposing a cell to one or more modulators that mimic one or more environmental cues.  FIG. 1  shows an example of how biology determines response to therapy. For example, without intending to be limited to any theory, a responsive cell treated with Ara-C will undergo cell death through activation of DNA damage and apoptosis pathways. However, a non-responsive cell might escape apoptosis through disruption in one or more pathways that allows the cell to survive. For instance, a non-responsive cell might have increased concentration of a drug transporter (e.g., MPR-1), which causes Ara-C to be removed from the cells. A non-responsive cell might also have disruptions in one or more pathways involved in proliferation, cell cycle progression and cell survival that allows the cell to survive. A non-responsive cell may have a DNA damage response pathway that fails to communicate with apoptosis pathways. A non-responsive cell might also have disruptions in one or more pathways involve in proliferation, cell cycle progression and cell survival that allows the cell to survive. The disruptions in these pathways can be revealed, for example, by exposing the cell to a growth factor such as FLT3L or G-CSF. In addition, the revealed disruptions in these pathways can allow for identification of target therapies that will be more effective in a particular patient and can allow the identification of new druggable targets, which therapies can be used alone or in combination with other treatments. Expression levels of proteins, such as drug transporters and receptors, may not be as informative by themselves for disease management as analysis of activatable elements, such as phosphorylated proteins. However, expression information may be useful in combination with the analysis of activatable elements, such as phosphorylated proteins. 
     The discussion below describes some of the preferred embodiments with respect to particular diseases. However, it should be appreciated that the principles may be useful for the analysis of many other diseases as well 
     Single Cell Network Profiling (SCNP) 
     Single cell network profiling (SCNP) is a method that can be used to analyze activatable elements, such as phosphorylation sites of proteins, in signaling pathways in single cells in response to modulation by signaling agonists or inhibitors (e.g., kinase inhibitors). Other examples of activatable elements include an acetylation site, a ubiquitination site, a methylation site, a hydroxylation site, a SUMOylation site, or a cleavage site. Activation of an activatable element can involve a change in cellular localization or conformation state of individual proteins, or change in ion levels, oxidation state, pH etc. It is useful to classify cells and to provide diagnosis or prognosis as well as other activities, such as drug screening or research, based on the cell classifications. SCNP is one method that can be used in conjunction with an analysis of cell health, but there are other methods that may benefit from this analysis. Embodiments of SCNP are shown in references cited herein. See for example, U.S. Pat. No. 7,695,924. 
     In one embodiment, SCNP can be used to generate a cell signaling profile. In another embodiment, SCNP can be used to measure apoptosis in cells stained with an antibody with specific affinity to cleaved PARP (cPARP or PARP+), for example, after the cells have been exposed to one or more modulators, such as chemotherapy drugs or other treatments. Other cell health markers may be quantified as well. In one embodiment, the one or more cell health markers can be MCL-1 and/or cPARP. 
     A significant fraction of cells with high cleaved PARP levels or low MCL-1 levels, before or without treatment with, e.g., a modulator, can indicate that some cells are undergoing apoptosis before treatment with a modulator. For some experiments, the activation state or activation level of an activatable element in an untreated sample of cells may be attributable to cells undergoing apoptosis due to one or more reasons related to sample processing (e.g., shipment conditions, cryogenic storage, thawing of cryogenically stored cells, etc.). If the apoptotic cells are not physically removed from the analysis, or data from apoptotic cells is not removed from an analysis of cell signaling data, apoptotic cells (which can be cleaved PARP positive or MCL-1 negative) can negatively impact the measurement of treatment (e.g., with a modulator) induced activation of an activatable element, e.g., phosphorylation of a phosphorylation site, and cause a misleading view of the signaling potential for the specific cell population being studied. 
     Quality Control 
     It is highly desirable to be consistent and to minimize errors with medical testing, including clinical testing, drug discovery, patient monitoring and prognostic or preclinical tests. These errors may affect patient life as well as jeopardizing the progress of a diagnostic test or a new drug. One embodiment of the present invention enables a researcher to monitor the fidelity of the assay under different variables, for example different operators, lots, reagents, cell lines, times, geographical locations, sample holders, such as wells or plates, and runs. One embodiment of the present invention is a method to provide controls for a plurality of phases of the assay. One or more control modules may be employed to monitor the process from start to finish. For example, one control module may span more than one step and others may span less steps. 
     Previously filed patent applications have elements used in the present process and include the use of control beads, the use of monitoring software, and the use of automation. See U.S. Ser. Nos. 12/776,349, 12/501,274 and 12/606,869 respectively. All applications are hereby incorporated by reference in their entireties. 
     One embodiment of the present invention uses the SCNP process in which samples are thawed, modulated, stained, and acquired. Some control processes described herein will be useful for all process steps and others will be more focused on one or two steps. 
     See also U.S. Ser. No. 61/557,831 which is hereby incorporated by reference. 
     INTRODUCTION 
     Hematopoietic cells are blood-forming cells in the body. Hematopoiesis (development of blood cells) begins in the bone marrow and depending on the cell type, further maturation occurs either in the periphery or in secondary lymphoid organs such as the spleen or lymph nodes. Hematopoietic disorders are recognized as clonal diseases, which are initiated by somatic and/or inherited mutations that cause dysregulated signaling in a progenitor cell. The wide range of possible mutations and accompanying signaling defects accounts for the diversity of disease phenotypes observed within this group of disorders. Hematopoietic disorders fall into three major categories: Myelodysplastic syndromes (MDS), myeloproliferative disorders (MPN), and acute leukemias. Examples of hematopoietic disorders include non-B lineage derived, such as acute myeloid leukemia (AML), Chronic Myeloid Leukemia (CML), non-B cell acute lymphocytic leukemia (ALL), myelodysplastic disorders, myeloproliferative disorders, polycythemias, thrombocythemias, or non-B atypical immune lymphoproliferations. Examples of B-Cell or B cell lineage derived disorder include Chronic Lymphocytic Leukemia (CLL), B lymphocyte lineage leukemia, Multiple Myeloma, acute lymphoblastic leukemia (ALL), B-cell pro-lymphocytic leukemia, precursor B lymphoblastic leukemia, hairy cell leukemia or plasma cell disorders, e.g., amyloidosis or Waldenstrom&#39;s macroglobulinemia. AML will be further discussed below. MDS and MPN are discussed in U.S. Ser. Nos. 12/910,769, 12/460,029 and 61/565,391 which are incorporated by reference in their entireties. 
     Acute myeloid leukemia (AML), myelodysplastic syndrome (MDS), and myeloproliferative neoplasms (MPN) are examples of distinct myeloid hematopoietic disorders. However, it is recognized that these disorders share clinical overlap in that 30% of patients with MDS and 5-10% of patients with MPN will go on to develop AML. AML will be discussed as an example, but some of the advantages of the present methods, like the analysis methods, will be applicable to more than AML, MPN, MPD or hematopoetic diseases. 
     This application also discusses pediatric patients, which are defined as less than 21 years old, typically measured at diagnosis. In another embodiment, pediatric is less than 18 years old. 
     Cell-Signaling Pathways and Differentiating Factors Involved 
     a. AML 
     Alterations of kinases and phosphatases lead to inappropriate signal transduction, whereas alterations of transcription factors give rise to inappropriate gene expression. Both of these mechanisms contribute to the pathogenesis of AML by the induction of increased proliferation, reduced apoptosis and block of differentiation. The dysregulation of one or more of the key signaling pathways (e.g., RAS/MAPK, PI3K/AKT, and JAK/STAT) is believed to result in growth factor-independent proliferation and clonal expansion of hematopoietic progenitors (HOX deregulation in acute myeloid leukemia.  Journal of Clinical Investigation.  2007, vol. 117, no. 4, p. 865-868.) See generally Table 1 below which depicts pathways relevant for AML Biology. In some embodiments, the pathways depicted in Table 1 are characterized using the methods described herein by exposing cells to the modulators listed in the table and measuring the readout listed in the table, for each corresponding pathways. Disruption in one or more pathways can be revealed by exposing the cells to the modulators. This can then be used for classification, diagnosis, prognosis of AML, selection of treatment and/or predict outcome after administering a therapeutic. 
     
       
         
           
               
               
               
             
               
                 TABLE 1 
               
               
                   
               
               
                 Pathway  
                 Readout 
                 Modulator 
               
               
                   
               
             
            
               
                 DNA Damage  
                 p-Chk1, p-Chk2, p-ATM, p-ATR,  
                 Etoposide, Ara-C/Daunorubicin, Drug Pump  
               
               
                   
                 p-H2AX  
                 Inhibitors, Mylotarg  
               
               
                 Drug transporters  
                 MDR-1, ABCG2, MPR  
                 Drug Pump Inhibitors  
               
               
                 Apoptosis  
                 Bcl-2, Mcl-1, cytochrome c, survivin,  
                 Staurosporine, Etoposide, Ara-C/  
               
               
                   
                 XIAP PARP, Caspses 3, 7 and 8  
                 Daunorubicin, Drug Pump Inhibitors,  
               
               
                   
                   
                 Mylotarg, Zvad, Caspase Inhibitors,  
               
               
                 Phosphatases  
                 Shp-1, Shp-2, , CD45  
                 H 2 0 2    
               
               
                 JAK/STAT  
                 p-Stat 1, 3, 4, 5, 6  
                 Cytokine and Growth Factors  
               
               
                 Cell Cycle  
                 Myc, Ki-67, Cyclins, DNA stains,  
                 Cytokine and Growth Factors, Mitogens,  
               
               
                   
                 p-RB, p16, p21, p27, p15, cyclin D1,  
                 Apoptosis inducing agents,  
               
               
                   
                 cyclin B1, p-Cdk1, p-histoneH3,  
                   
               
               
                   
                 p-CDC25  
                   
               
               
                 MAPK  
                 Ras, p-Mek, p-Erk, p-S6, p-38  
                 Cytokine and Growth Factors, Mitogens,  
               
               
                 PI3K-AKT  
                 p-Akt, p-S6, p-PRAS40, p-GSK3,  
                 Cytokines, Growth Factors, Mitogens,  
               
               
                   
                 p-TSC2, p-p70S6K, 4-EBP1, p-FOXO  
                 chemokines, Receptor Tyrosine Kinase (RTK)  
               
               
                   
                 proteins  
                 ligands  
               
               
                 FLT3 and other RTKs  
                 p-PLCg 1/2, p-CREB, total CREB,  
                 Flt3L, Receptor Tyrosine Kinase (RTK)  
               
               
                   
                 p-Akt, p-Erk, p-56  
                 ligands  
               
               
                 Angiogenesis  
                 PLCγ1, p-Akt, p-Erk  
                 VEGF stim  
               
               
                 Wnt/b-catenin  
                 Active B-Catenin, Myc, Cyclin D  
                 RTK ligands, growth factors  
               
               
                 Survival  
                 PI3K, PLCg, Stats  
                 RKT Growth Factors 
               
               
                   
               
            
           
         
       
     
     There are two main classes of receptors which play an important role in hematopoiesis: Receptors with intrinsic tyrosine kinase activity (RTKs) and those that do not contain their own enzymatic activity and often consist of heterodimers of a ligand-binding alpha subunit and a signal transducing beta subunit, which is frequently shared between a subset of cytokine receptors. Cytoplasmic tyrosine kinases phosphorylate cytokine receptors thereby creating docking sites for signaling molecules resulting in activation of a specific intracellular signaling pathway. Of the first class, Kit and FLt3 receptor have been shown to play an important role in the pathogenesis of AML. Extracellular ligand binding regulates the intracellular substrate specificity, affinity and kinase activity of these proteins. Therefore, the receptor transmits its signal through binding and/or phosphorylation of intracellular signaling intermediates. Despite these differences, the signals transmitted by both classes of receptors ultimately converge on one or more of the key signaling pathways, such as the Ras/Raf/MAPK, PI3K/AKT, and JAK/STAT pathways. 
     The STAT (signal transducer and activator of transcription) family of proteins, especially STAT3 and STAT5, are emerging as important players in several cancers. (Yu 2004—STATs in cancer. (2008) pp. 9). Of particular relevance to AML, the STATs have been shown to be critical for myeloid differentiation and survival, as well as for long-term maintenance of normal and leukemic stem cells. (Schepers et al. STAT5 is required for long-term maintenance of normal and leukemic human stem/progenitor cells. Blood (2007) vol. 110 (8) pp. 2880-2888) STAT signaling is activated by several cytokine receptors, which are differentially expressed depending on the cell type and the stage of differentiation. Intrinsic or receptor-associated tyrosine kinases phosphorylate STAT proteins, causing them to form a homodimer. The activated STAT dimer is able to enter the cell nucleus and activate the transcription of target genes, many of which are involved in the regulation of apoptosis and cell cycle progression. Apart from promoting proliferation and survival, some growth factor receptors and signaling intermediates have been shown to play specific and important roles in myeloid differentiation. For example, G-CSF- or TPO-induced activation of the Ras-Raf-MAP Kinase pathway promotes myeloid or megakaryocytic differentiation in the respective progenitor cells by the activation of c/EBPα (frequently inactivated in myeloid leukemias) and GATA-1, respectively. (B. STEFFEN et al. Critical Reviews in  Oncology/Hematology.  2005, vol. 56, p. 195-221.) 
     Phosphatases: 
     One of the earliest events that occurs after engagement of myeloid receptors is the phosphorylation of cellular proteins on serine, threonine, and tyrosine residues 8, 9, 10. The overall level of phosphorylated tyrosine residues is regulated by the competing activities of protein tyrosine kinases (PTKs) and protein tyrosine phosphatases (PTPs). Decreases in the activity of tyrosine phosphatases may also contribute to an increase in cellular tyrosine phosphorylation following stimulation. 
     SHP-1 (PTPN6) is a non-receptor protein tyrosine phosphatase that is expressed primarily in hematopoietic cells. The enzyme is composed of two SH2 domains, a tyrosine phosphatase catalytic domain and a carboxy-terminal regulatory domain (Yi, T. L. et al. (1992) Mol Cell Biol 12, 836-46). SHP-1 removes phosphates from target proteins to down regulate several tyrosine kinase regulated pathways. In hematopoietic cells, the N-terminal SH2 domain of SHP-1 binds to tyrosine phosphorylated erythropoietin receptors (EpoR) to negatively regulate hematopoietic growth (Yi, T. et al. (1995) Blood 85, 87-95). Following ligand binding in myeloid cells, SHP-1 associates with IL-3R β chain and down regulates IL-3-induced tyrosine phosphorylation and cell proliferation (Yi, T. et al. (1993) Mol Cell Biol 13, 7577-86). Because SHP-1 downregulates signaling pathways emanating from receptor tyrosine kinases, cytokine receptors, multi-chain recognition receptors and integrins, it is considered a potential tumor suppressor (Wu, C. et al. (2003) Gene 306, 1-12, Bhattacharya, R. et al. (2008) J Mol Signal 3, 8). 
     SHP-2 (PTPN11) is a ubiquitously expressed, nonreceptor protein tyrosine phosphatase (PTP). It participates in signaling events downstream of receptors for growth factors, cytokines, hormones, antigens and extracellular matrices in the control of cell growth, differentiation, migration and death (Qu, C. K. (2000) Cell Res 10, 279-88). Activation of SHP-2 and its association with Gabi is critical for sustained Erk activation downstream of several growth factor receptors and cytokines (Maroun, C. R. et al. (2000) Mol Cell Biol 20, 8513-25.). 
     In AML, when active SHP-1 and SHP-2 dephosphorylates protein kinase (See Koretzky G A et al. Nat Rev Immunol. 2006 January; 6(1):67-78. Review). Treatment of cells with a general tyrosine phosphatase inhibitor such as H 2 O 2  results in an increase in phosphorylation of intracellular signalling molecules. In this experiment, AML patients that were complete responders (CR) to one cycle of standard 7+3 induction therapy showed higher levels of phosphorylated PLCγ2 and SLP-76 upon H 2 O 2  treatment when compared with non-responders (NR). 
     FLt3 Ligand Mutations: 
     During normal hematopoietic development, the FLT3 receptor functions in the differentiation and proliferation of multipotent stem cells and their progeny in the myeloid, B cell, and T cell lineages. (Gilliland, G. D., and Griffin, J. D. The roles of FLT3 in hematopoesis and leukemia. Blood (2002) 100: 1532-42). FLT3 receptor expression is normally restricted to hematopoietic progenitors, and genetic ablation experiments have shown that FLT3 is required for the maturation of these early cells, but is not required in mature cells (Rosnet O., et al, Human FLT3/FLK2 receptor tyrosine kinase is expressed at the surface of normal and malignant hematopoietic cells. Leukemia (1996) 10; 238-48; Mackarehtschian K., et al. Targeted disruption of the flk2/flt3 gene leads to deficiencies in primitive hematopoietic progenitors. Immunity (1995) 3: 147-61). 
     Mutations in FLT3 are found in 25-45% of all AML patients (Renneville A., et al, Cooperating gene mutations in acute myeloid leukemia: a review of the literature. Leukemia (2008) 22: 915-31). Of the AML-associated FLT3 mutations, the most common is the internal tandem duplication (ITD), which is found in 25-35% of adult AML patients (Id). The ITD is an in-frame duplication of 3-400 nucleotides that encodes a lengthened FLT3 juxtamembrane domain (JMD) (Schnittger S., et al. FLT3 internal tandem duplication in 234 children with acute myeloid leukemia (AML): prognostic significance and relation to cellular drug resistance. Blood (2003) 102: 2387-94.). In vitro studies have shown that FLT3/ITDs promote ligand-independent receptor dimerization, leading to autonomous phosphorylation and constitutive activation of the receptor (Gilliand, G. D, and Griffin, J. D. Blood (2002) 100: 1532-42). Structural studies of FLT3 suggest that in the wild-type receptor, the JMD produces steric hindrance that prevents autodimerization (Griffith, J., et al. The Structural Basis for Autoinhibition of FLT3 by the Juxtamembrane Domain. Molecular Cell (2004) 13: 169-78). The ITD-associated lengthening of the JMD appears to remove this hindrance, resulting in autodimerization and constitutive FLT3 kinase activity. The second class of FLT3 mutation, found in 5-10% of AML patients, comprises missense point mutations in exon 20—commonly in codons D835, 1836, N841, or Y842—which produce amino acid substitutions in the activation loop of the FLT3 tyrosine kinase domain (TKD) (Yamamoto Y., et al, Activating mutation of D835 within the activation loop of FLT3 in human hematologic malignancies. Blood (2001) 97: 2434-39). Investigators have also identified several AML-associated point mutations in the FLT3 JMD (Stirewalt D. L., et al. Novel FLT3 point mutations within exon 14 found in patients with acute myeloid leukemia. Br. J. Haematol (2004) 124: 481-84), and one in the N-terminal portion of the Tyrosine Kinase Domain (Schittenheim M. M., et al. FLT3 K663Q is a novel AML-associated oncogenic kinase: determination of biochemical properties and sensitivity to sunitnib. Leukemia (2006) 20: 2008-14.). 
     The AML-associated FLT3 mutations generally cause ligand-independent autophosphorylation of the FLT3 receptor and subsequent activation of downstream signaling pathways, such as PI3K, Ras, and JAK/STAT (Renneville, et al. (2008) 22: 915-31). However, the FLT3-ITD and TKD mutations are associated with significant biological differences (Renneville, et al. (2008) 22: 915-31). FLT3-ITD mutations constitutively induce STAT5phosphorylation, while FLT3-TKD mutations only weakly induce STAT5phosphorylation (Choudry, C. et al. AML-associated Flt3 kinase domain mutations show signal transduction differences compared with Flt3-ITD mutations. Blood (2005) 106: 265-73). Furthermore, FLT3-ITD, but not TKD mutations suppress expression of the transcription factors, c/EBPα and Pu. 1, which function in myeloid differentiation. Additionally, neither class of FLT3 mutation is sufficient to induce AML, suggesting that additional mechanisms may be involved (Renneville, et al. (2008) 22: 915-31). Many investigational new drugs are targeted to FLT3 receptor kinase activity (Gilliland, G. D., and Griffin, J. D. Blood (2002) 100: 1532-42). However, the different cell signaling profiles of AML-associated mutations suggest that different AML patients will exhibit distinct responses to inhibition of FLT3 kinase activity. Pre-screening patient cell samples for a response to a FLT3 kinase inhibitor drug, for example by examining the effects of drug treatment on pSTAT5 levels, may predict whether a patient will respond to that drug. 
     Clinically, FLT3-TKD mutations correlate with shorter clinical response duration and worse overall survival than for patients carrying the FLT3-TKD or wild-type alleles (Meshinchi, S and Applebaum, F Clin. Can. Res. (2009) 13: 4263-4269; Frohling et al. Prognostic significance of activating FLT3 mutations in younger adults (16 to 60 years) with acute myeloid leukemia and normal cytogenetics: a study of the AML Study Group Ulm. Blood (2002) 100: 4372-80.). The presence of the FLT3-ITD mutation and the ratio of the FLT3-ITD mutation to other FLT3 alleles are predictive of clinical response duration, cumulative incidence of relapse, and patient overall survival (Renneville, et al. (2008) 22: 915-31). 
     In healthy myeloid lineages, G-CSF promotes cell proliferation through activation of JAK/STAT signaling (Touw, I. P., and Marijke, B., Granulocyte colony-stimulating factor: key factor or innocent bystander in the development of secondary myeloid malignancy? (2007). J. Natl. Cancer. Inst. 99: 183-186). A class of AML-associated mutations produces truncated G-CSF receptor, and causes hyperreponsiveness to G-CSF stimulation (Gert-Jan, M. et al. G-CSF receptor truncations found in SCN/AML relieve SOCS3-controlled inhibition of STAT5 but leave suppression of STAT3 intact. Blood (2004) 104: 667-74.). Stimulation of AML patient blast cells with G-CSF in vitro revealed potentiated Stat3 and Stat5 phosphorylations that correlated with poor response to chemotherapy (Irish, J. M., et al. Single Cell Profiling of Potentiated Phospho-Protein Networks in Cancer Cells. Cell (2004) 118: 217-28.). 
     The process of angiogenesis may contribute to leukemic cell survival and a resultant resistance to chemotherapy-triggered cell death. Vascular endothelial growth factor (VEGF) is a major determinant of angiogenesis. A significant proportion of de novo and secondary AML blast populations produce and secrete VEGF protein. Moreover, blasts from some patients with newly diagnosed AML exhibit relative overexpresssion of VEGF Receptor R2 (Padro T, Bieker R, Ruiz S, et al. Overexpression of vascular endothelial growth factor (VEGF) and its cellular receptor KDR (VEGFR-2) in the bone marrow of patients with acute myeloid leukemia. Leukemia 2002; 16:1302). Furthermore, the incorporation of the anti-VEGF monoclonal antibody bevacizumab (Avastin) into an AML combination therapy reportedly improved tumor clearance rates. (Karp, J. E., et al. Targeting Vascular Endothelial Growth Factor for Relapsed and Refractory Adult Acute Myelogenous Leukemias. Clinical Cancer Res. (2004) 10: 3577-85). 
     In addition to Flt3, a variety of other genes are mutated in AML and can be divided into two classes based on whether they confer a favorable or non-favorable prognosis. Mutations in the chaperone protein-encoding gene NPM1 have been found in 30% of adults with de novo AML, but not in adults with secondary AML (Renneville, et al. (2008) 22: 915-31). Among patients with cytogenetically normal AML, NPM1 mutations are predictive of higher rates of response to induction therapy and longer overall survival, but only in the absence of FLT3-ITD mutations. Mutations in the basic region leucine zipper-encoding gene CEBPA are found in 15-19% of AML patients, and are predictive of longer overall survival and longer complete response duration (Baldus, C. D., et al. Clinical outcome of de novo acute myeloid leukemia patients with normal cytogenetics is affected by molecular genetic alterations: a concise review.  British J Haematology  (2007) 137: 387-400). 
     Mutated genes that confer a non-favorable prognosis include ERG which encodes a transcription factor activated by signal transduction pathways that regulates cell differentiation, proliferation, and tissue invasion (Baldus, C. D., et al.  British J. Haematology  (2007) 137: 387-400.). Overexpression of ERG in AML patients is predictive of a higher rate of relapse and shorter overall survival (Marcucci et al, Overexpression of the ETS-related gene, ERG, predicts a worse outcome in acute myeloid leukemia with normal karyotype: a Cancer and Leukemia Group B study.  J. Clinical Oncology  (2005) 23: 9234-42). High expression of BAALC in younger AML patients (under 60 years old) is associated with lower rates of disease-free survival and overall survival (Baldus et al, BAALC expression predicts clinical outcome of de novo acute myeloid leukemia patients with normal cytogenetics: a Cancer and Leukemia Group B study. Blood (2003) 102: 1613-18). Overexpression of MN1 in AML patients is associated with a lower rate of response to induction therapy (Baldus, C. D., et al.  British J. Haematology  (2007) 137: 387-400.). Gain-of-function mutations in the receptor tyrosine kinase-encoding gene c-KIT are predictive of shorter overall complete response duration and overall survival in AML patients, and may also be predictive of response to treatment with tyrosine kinase inhibitors (Renneville, et al. (2008) 22: 915-31). Mutations in the Wlim&#39;s Tumor 1 (WT1) gene are found in 10-15% of AML cases, and in cytogenetically normal AML patients, are predictive of failure to achieve complete response to chemotherapy (Renneville, et al. (2008) 22: 915-31). Point mutations in the RAS oncogenes are found in 10-20% of AML patients, but prognostic uses of these mutations have not yet been identified (Renneville, et al. (2008) 22: 915-31). 
     RAS mutations: Ras proteins normally act as signaling switches, which alternate between the active (GTP-bound) and inactive (GDP-bound) states. Somatic point mutations in codons 12, 13 and 61 of the NRAS and KRAS genes occur in many myeloid malignancies, resulting in persistently active forms of the protein. Analyses of patients with MDS revealed a very high risk of transformation to AML in patients with N-RAS mutations, providing evidence that these mutations might represent an important progression factor in MDS. Under the two-hit model put forth by Gilliland et al., RAS mutations are likely to provide a growth advantage, which when combined with a secondary mutation that blocks differentiation, results in AML. Supporting this model, N-RAS or K-RAS mutations were found in 22% of cases of core binding factor AML (CBF-AML), which is defined by AML1-ETO or CBFβ-MYH11 gene fusions known to disrupt differentiation. (Boissel et al. Incidence and prognostic impact of c-Kit, FLT3 LIGAND, and Ras gene mutations in core binding factor acute myeloid leukemia (CBF-AML). Leukemia (2006) vol. 20 (6) pp. 965-970) 
     One embodiment of the invention will look at any of the cell signaling pathways described above in classifying diseases, such as AML. Modulators can be designed to investigate these pathways and any relevant parallel pathways. Other embodiments include diseases besides AML. 
     In some embodiments, the invention provides a method for diagnosis, prognosis, determining progression, predicting response to treatment or choosing a treatment for AML, the method comprising the steps of (a) subjecting a cell population from the individual to a plurality of distinct modulators, (b) characterizing a plurality of pathways in one or more cells comprising determining an activation level of at least one activatable element in at least three pathways, where the pathways are selected from the group consisting of apoptosis, cell cycle, signaling, or DNA damage pathways, and (c) correlating the characterization with diagnosis, prognosis, determining progression, predicting response to treatment or choosing a treatment for AML, in an individual, where the pathways characterization is indicative of the diagnosis, prognosis, determining progression, response to treatment or the appropriate treatment for AML. In some embodiments the activatable elements and modulators are selected from the activatable elements and modulators listed in Tables 1, 1(a)-1(e), 2, 3 or 5. In some embodiments, the activatable elements and modulators are selected from the activatable elements and modulators listed in Table 12 and are used to predict response duration in an individual after treatment. In some embodiments the modulator is selected from the group consisting of FLT3L, GM-CSF, SCF, G-CSF, SDF1a, LPS, PMA, Thapsigargin, IFNg, IFNa, IL-27, IL-3, IL-6, IL-10, ZVAD, H 2 O 2 , Staurosporine, Etoposide, Mylotarg, Daunorubicin, and AraC. In some embodiments, the individual has a predefined clinical parameter and the characterization of multiple pathways in combination with the clinical parameter is indicative of the diagnosis, prognosis, determining progression, predicting response to treatment or choosing a treatment for AML, in an individual. Examples of predetermined clinical parameters include, but are not limited to, age, de novo acute myeloid leukemia patient, secondary acute myeloid leukemia patient, or a biochemical/molecular marker. In some embodiments, the individual is over 60 years old. In some embodiments, the individual is under 60 years old. In some embodiments, when the individual is under 60 years old the activatable elements and modulators are selected from the activatable elements and modulators listed in Table 6. In some embodiments, where the individual is over 60 years the activatable elements and modulators are selected from the activatable elements and modulators listed in Table 7. In some embodiments, where the individual is a secondary acute myeloid leukemia patient the activatable elements and modulators are selected from the activatable elements and modulators listed in Table 8 and Table 9. In some embodiments, where the individual is a de novo acute myeloid leukemia patient the activatable elements and modulators are selected from the activatable elements and modulators listed in Table 10 and Table 11. In some embodiments, where the individual has a wild type FLT3 the activatable elements and modulators are selected from the activatable elements and modulators listed in Table 13. 
     In some embodiments, the activatable elements can demarcate AML cell subpopulations that have different genetic subclone origins. In some embodiments, the activatable elements can demarcate AML subpopulations that, in combination with additional surface molecules, can allow for surrogate identification of AML cell subpopulations. In some embodiments, the activatable elements can demarcate AML subpopulations that can be used to determine other protein, epitope-based, RNA, mRNA, siRNA, or metabolic markers that singly or coordinately allow for surrogate identification of AML cell subpopulations, disease stage of the individual from which the cells were derived, diagnosis, prognosis, response to treatment, or new druggable targets. In some embodiments, the pathways characterization allows for the delineation of AML cell subpopulations that are differentially susceptible to drugs or drug combinations. In other embodiments, the cell types or activatable elements from a given cell type will, in combination with activatable elements in other cell types, provide ratiometric or metrics that singly or coordinately allow for surrogate identification of AML cell subpopulations, disease stage of the individual from which the cells were derived, diagnosis, prognosis, response to treatment, or new druggable targets. 
     General Methods 
     Embodiments of the invention may be used to diagnose, predict or to provide therapeutic decisions for disease treatment, such as AML. In some embodiments, the invention may be used to identify new druggable targets and to design drug combinations. The following will discuss instruments, reagents, kits, and the biology involved with these and other diseases. One aspect of the invention involves contacting a hematopoietic cell with a modulator; determining the activation states of a plurality of activatable elements in the cell; and classifying the cell based on said activation state. 
     In some embodiments, this invention is directed to methods and compositions, and kits for analysis, drug screening, diagnosis, prognosis, for methods of disease treatment and prediction. In some embodiments, the present invention involves methods of analyzing experimental data. In some embodiments, the physiological status of cells present in a sample (e.g. clinical sample) is used, e.g., in diagnosis or prognosis of a condition, patient selection for therapy using some of the agents identified above, to monitor treatment, modify therapeutic regimens, and to further optimize the selection of therapeutic agents which may be administered as one or a combination of agents. Hence, therapeutic regimens can be individualized and tailored according to the data obtained prior to, and at different times over the course of treatment, thereby providing a regimen that is individually appropriate. In some embodiments, a compound is contacted with cells to analyze the response to the compound. 
     In some embodiments, the present invention is directed to methods for classifying a sample derived from an individual having or suspected of having a condition, e.g., a neoplastic or a hematopoietic condition. The invention allows for identification of prognostically and therapeutically relevant subgroups of conditions and prediction of the clinical course of an individual. The methods of the invention provide tools useful in the treatment of an individual afflicted with a condition, including but not limited to methods for assigning a risk group, methods of predicting an increased risk of relapse, methods of predicting an increased risk of developing secondary complications, methods of choosing a therapy for an individual, methods of predicting duration of response, response to a therapy for an individual, methods of determining the efficacy of a therapy in an individual, and methods of determining the prognosis for an individual. The present invention provides methods that can serve as a prognostic indicator to predict the course of a condition, e.g. whether the course of a neoplastic or a hematopoietic condition in an individual will be aggressive or indolent, thereby aiding the clinician in managing the patient and evaluating the modality of treatment to be used. In another embodiment, the present invention provides information to a physician to aid in the clinical management of a patient so that the information may be translated into action, including treatment, prognosis or prediction. 
     In some embodiments, the invention is directed to methods of characterizing a plurality of pathways in single cells. Exemplary pathways include apoptosis, cell cycle, signaling, or DNA damage pathways. In some embodiments, the characterization of the pathways is correlated with diagnosing, prognosing or determining condition progression in an individual. In some embodiments, the characterization of the pathways is correlated with predicting response to treatment or choosing a treatment in an individual. In some embodiments, the characterization of the pathways is correlated with finding a new druggable target. In some embodiments, the pathways&#39; characterization in combination with a predetermined clinical parameter is indicative of the diagnosis, prognosis or progression of the condition. In some embodiments, the pathways&#39; characterization in combination with a predetermined clinical parameter is indicative of a response to treatment or of the appropriate treatment for an individual. In some embodiments, the characterization of the pathways in combination with a predetermined clinical parameter is indicative a new druggable target. 
     In some embodiments, the invention is directed to methods for determining the activation level of one or more activatable elements in a cell upon treatment with one or more modulators. The activation of an activatable element in the cell upon treatment with one or more modulators can reveal operative pathways in a condition that can then be used, e.g., as an indicator to predict course of the condition, to identify risk group, to predict an increased risk of developing secondary complications, to choose a therapy for an individual, to predict response to a therapy for an individual, to determine the efficacy of a therapy in an individual, and to determine the prognosis for an individual. In some embodiments, the operative pathways can reveal whether apoptosis, cell cycle, signaling, or DNA damage pathways are functional in an individual, where a pathway is functional if it is permissive for a response to a treatment. In some embodiments, when apoptosis, cell cycle, signaling, and DNA damage pathways are functional the individual can respond to treatment, and if at least one of the pathways is not functional the individual can not respond to treatment. In some embodiments, when the apoptosis and DNA damage pathways are functional the individual can respond to treatment. In some embodiments, the operative pathways can reveal new druggable targets. 
     In some embodiments, the invention is directed to methods of determining a phenotypic profile of a population of cells by exposing the population of cells to a plurality of modulators in separate cultures, determining the presence or absence of an increase in activation level of an activatable element in the cell population from each of the separate culture and classifying the cell population based on the presence or absence of the increase in the activation of the activatable element from each of the separate culture. In some embodiments at least one of the modulators is an inhibitor. In some embodiments, the presence or absence of an increase in activation level of a plurality of activatable elements is determined. In some embodiments, each of the activatable elements belongs to a particular pathway and the activation level of the activatable elements is used to characterize each of the particular pathways. In some embodiments, a plurality of pathways are characterized by exposing a population of cells to a plurality of modulators in separate cultures, determining the presence or absence of an increase in activation levels of a plurality of activatable elements in the cell population from each of the separate culture, wherein the activatable elements are within the pathways being characterized and classifying the cell population based on the characterizations of said multiple pathways. In some embodiments, the activatable elements and modulators are selected from the activatable elements and modulators listed in Tables 1, 2, 3 or 5. In some embodiments, the activatable elements and modulators are selected from the activatable elements and modulators listed in Table 12 and are used to predict response duration in an individual after treatment. 
     In some embodiments, the invention is directed to methods for classifying a cell by determining the presence or absence of an increase in activation level of an activatable element in the, in combination with additional expression markers. In some embodiments, expression markers or drug transporters, such as CD34, CD33, CD45, HLADR, CD11B, FLT3 Ligand, c-KIT, ABCG2, MDR1, BCRP, MRP1, LRP, and others noted below, can also be used for stratifying responders and non-responders. The expression markers may be detected using many different techniques, for example using nodes from flow cytometry data (see the articles and patent applications referred to above). Other common techniques employ expression arrays (commercially available from Affymetrix, Santa Clara Calif.), taqman (commercially available from ABI, Foster City Calif.), SAGE (commercially available from Genzyme, Cambridge Mass.), sequencing techniques (see the commercial products from Helicos, 454, US Genomics, and ABI) and other commonly know assays. See Golub et al., Science 286: 531-537 (1999). Expression markers are measured in unstimulated cells to know whether they have an impact on functional apoptosis. This provides implications for treatment and prognosis for the disease. Under this hypothesis, the amount of drug transporters correlates with the response of the patient and non-responders may have more levels of drug transporters (to move a drug out of a cell) as compared to responders. In some embodiments, the invention is directed to methods of classifying a cell population by contacting the cell population with at least one modulator that affects signaling mediated by receptors selected from the group comprising of growth factors, mitogens and cytokines. In some embodiments, the invention is directed to methods of classifying a cell population by contacting the cell population with at least one modulator that affects signaling mediated by receptors selected from the group comprising SDF-1α, IFN-α, IFN-γ, IL-10, IL-6, IL-27, G-CSF, FLT-3L, IGF-1, M-CSF, SCF, PMA, and Thapsigargin; determining the activation states of a plurality of activatable elements in the cell comprising; and classifying the cell based on said activation states and expression levels. In some embodiments, the cell population is also exposed in a separate culture to at least one modulator that slows or stops the growth of cells and/or induces apoptosis of cells. In some embodiments, the modulator that slows or stops the growth of cells and/or induces apoptosis of cells is selected from the group consisting of, Etoposide, Mylotarg, AraC, daunorubicin, staurosporine, benzyloxycarbonyl-Val-Ala-Asp (OMe) fluoromethylketone (ZVAD), lenalidomide, EPO, and azacitadine, decitabine. In some embodiments, the cell population is also exposed in a separate culture to at least one modulator that is an inhibitor. In some embodiments the inhibitor is H 2 O 2 . In some embodiments, the expression of a growth factor receptor, cytokine receptor and/or a drug transporter is also measured. In some embodiments, the methods comprise determining the expression level at least one protein selected from the group comprising ABCG2, C-KIT receptor, and FLT3 LIGAND receptor. Another embodiment of the invention further includes using the modulators IL-3, IL-4, GM-CSF, EPO, LPS, TNF-α, and CD40L. In some embodiments, the cell population in a hematopoietic cell population. In some embodiments, the invention is directed to methods of correlating and/or classifying an activation state of an AML cell with a clinical outcome in an individual by subjecting the AML cell from the individual to a modulator, determining the activation levels of a plurality of activatable elements, and identifying a pattern of the activation levels of the plurality of activatable elements to determine the presence or absence of an alteration in signaling, where the presence of the alteration is indicative of a clinical outcome. In some embodiments, the activatable elements can demarcate AML cell subpopulations that have different genetic subclone origins. In some embodiments, the activatable elements can demarcate AML subpopulations that can be used to determine other protein, epitope-based, RNA, mRNA, siRNA, or metabolomic markers that singly or coordinately allow for surrogate identification of AML cell subpopulations, disease stage of the individual from which the cells were derived, diagnosis, prognosis, response to treatment, or new druggable targets. In some embodiments, the pathways characterization allows for the delineation of AML cell subpopulations that are differentially susceptible to drugs or drug combinations. In other embodiments, the cell types or activatable elements from a given cell type will, in combination with activatable elements in other cell types, provide ratiometric or metrics that singly or coordinately allow for surrogate identification of AML cell subpopulations, disease stage of the individual from which the cells were derived, diagnosis, prognosis, response to treatment, or new druggable targets. 
     The subject invention also provides kits for use in determining the physiological status of cells in a sample, the kit comprising one or more modulators, inhibitors, specific binding elements for signaling molecules, and may additionally comprise one or more therapeutic agents. The above reagents for the kit are all recited and listed in the present application below. The kit may further comprise a software package for data analysis of the cellular state and its physiological status, which may include reference profiles for comparison with the test profile and comparisons to other analyses as referred to above. The kit may also include instructions for use for any of the above applications. 
     In some embodiments, the invention provides methods, including methods to determine the physiological status of a cell, e.g., by determining the activation level of an activatable element upon contact with one or more modulators. In some embodiments, the invention provides methods, including methods to classify a cell according to the status of an activatable element in a cellular pathway. In some embodiments, the cells are classified by analyzing the response to particular modulators and by comparison of different cell states, with or without modulators. The information can be used in prognosis and diagnosis, including susceptibility to disease(s), status of a diseased state and response to changes, in the environment, such as the passage of time, treatment with drugs or other modalities. The physiological status of the cells provided in a sample (e.g. clinical sample) may be classified according to the activation of cellular pathways of interest. The cells can also be classified as to their ability to respond to therapeutic agents and treatments. The physiological status of the cells can provide new druggable targets for the development of treatments. These treatments can be used alone or in combination with other treatments. The physiological status of the cells can be used to design combination treatments. 
     One or more cells or cell types, or samples containing one or more cells or cell types, can be isolated from body samples. The cells can be separated from body samples by centrifugation, elutriation, density gradient separation, apheresis, affinity selection, panning, FACS, centrifugation with Hypaque, solid supports (magnetic beads, beads in columns, or other surfaces) with attached antibodies, etc. By using antibodies specific for markers identified with particular cell types, a relatively homogeneous population of cells may be obtained. Alternatively, a heterogeneous cell population can be used. Cells can also be separated by using filters. For example, whole blood can also be applied to filters that are engineered to contain pore sizes that select for the desired cell type or class. Rare pathogenic cells can be filtered out of diluted, whole blood following the lysis of red blood cells by using filters with pore sizes between 5 to 10 μm, as disclosed in U.S. patent application Ser. No. 09/790,673. Once a sample is obtained, it can be used directly, frozen, or maintained in appropriate culture medium for short periods of time. Methods to isolate one or more cells for use according to the methods of this invention are performed according to standard techniques and protocols well-established in the art. See also U.S. Ser. Nos. 12/432,720, 12/229,476, and 12/432,239. See also, the commercial products from companies such as BD and BCI as identified above. 
     See also U.S. Pat. Nos. 7,381,535 and 7,393,656. All of the above patents and applications are incorporated by reference as stated above. 
     In some embodiments, the cells are cultured post collection in a media suitable for revealing the activation level of an activatable element (e.g. RPMI, DMEM) in the presence, or absence, of serum such as fetal bovine serum, bovine serum, human serum, porcine serum, horse serum, or goat serum. When serum is present in the media it could be present at a level ranging from 0.0001% to 30%. 
     In some embodiments, the cells are hematopoietic cells. Examples of hematopoietic cells include but are not limited to pluripotent hematopoietic stem cells, B-lymphocyte lineage progenitor or derived cells, T-lymphocyte lineage progenitor or derived cells, NK cell lineage progenitor or derived cells, granulocyte lineage progenitor or derived cells, monocyte lineage progenitor or derived cells, megakaryocyte lineage progenitor or derived cells and erythroid lineage progenitor or derived cells. 
     The term “patient” or “individual” as used herein includes humans as well as other mammals. The methods generally involve determining the status of an activatable element. The methods also involve determining the status of a plurality of activatable elements. 
     In some embodiments, the invention provides a method of classifying a cell by determining the presence or absence of an increase in activation level of an activatable element in the cell upon treatment with one or more modulators, and classifying the cell based on the presence or absence of the increase in the activation of the activatable element. In some embodiments of the invention, the activation level of the activatable element is determined by contacting the cell with a binding element that is specific for an activation state of the activatable element. In some embodiments, a cell is classified according to the activation level of a plurality of activatable elements after the cell have been subjected to a modulator. In some embodiments of the invention, the activation levels of a plurality of activatable elements are determined by contacting a cell with a plurality of binding elements, where each binding element is specific for an activation state of an activatable element. 
     The classification of a cell according to the status of an activatable element can comprise classifying the cell as a cell that is correlated with a clinical outcome. In some embodiments, the clinical outcome is the prognosis and/or diagnosis of a condition. In some embodiments, the clinical outcome is the presence or absence of a neoplastic or a hematopoietic condition such as AML. In some embodiments, the clinical outcome is the staging or grading of a neoplastic or hematopoietic condition. Examples of staging include, but are not limited to, aggressive, indolent, benign, refractory, Roman Numeral staging, TNM Staging, Rai staging, Binet staging, WHO classification, FAB classification, IPSS score, WPSS score, limited stage, extensive stage, staging according to cellular markers, occult, including information that may inform on time to progression, progression free survival, overall survival, or event-free survival. 
     The classification of a cell according to the status of an activatable element can comprise classifying a cell as a cell that is correlated to a patient response to a treatment. In some embodiments, the patient response is selected from the group consisting of complete response, partial response, nodular partial response, no response, progressive disease, stable disease and adverse reaction. 
     The classification of a rare cell according to the status of an activatable element can comprise classifying the cell as a cell that can be correlated with minimal residual disease or emerging resistance. See U.S. Ser. No. 12/432,720 which is incorporated by reference. 
     The classification of a cell according to the status of an activatable element can comprise selecting a method of treatment. Example of methods of treatments include, but are not limited to chemotherapy, biological therapy, radiation therapy, bone marrow transplantation, Peripheral stem cell transplantation, umbilical cord blood transplantation, autologous stem cell transplantation, allogeneic stem cell transplantation, syngeneic stem cell transplantation, surgery, induction therapy, maintenance therapy, watchful waiting, and other therapy. 
     A modulator can be an activator, an inhibitor or a compound capable of impacting cellular signaling networks. Modulators can take the form of a wide variety of environmental cues and inputs. Examples of modulators include but are not limited to growth factors, mitogens, cytokines, adhesion molecules, drugs, hormones, small molecules, polynucleotides, antibodies, natural compounds, lactones, chemotherapeutic agents, immune modulators, carbohydrates, proteases, ions, reactive oxygen species, radiation, physical parameters such as heat, cold, UV radiation, peptides, and protein fragments, either alone or in the context of cells, cells themselves, viruses, and biological and non-biological complexes (e.g. beads, plates, viral envelopes, antigen presentation molecules such as major histocompatibility complex). One exemplary set of modulators, include but are not limited to SDF-1α, IFN-α, IFN-γ, IL-10, IL-6, IL-27, G-CSF, FLT-3L, IGF-1, M-CSF, SCF, PMA, Thapsigargin, H 2 O 2 , Etoposide, Mylotarg, AraC, daunorubicin, staurosporine, benzyloxycarbonyl-Val-Ala-Asp (OMe) fluoromethylketone (ZVAD), lenalidomide, EPO, azacitadine, decitabine, IL-3, IL-4, GM-CSF, EPO, LPS, TNF-α, and CD40L. 
     In some embodiments, the modulator is an activator. In some embodiments the modulator is an inhibitor. In some embodiments, the invention provides methods for classifying a cell by contacting the cell with an inhibitor, determining the presence or absence of an increase in activation level of an activatable element in the cell, and classifying the cell based on the presence or absence of the increase in the activation of the activatable element. In some embodiments, a cell is classified according to the activation level of a plurality of activatable elements after the cells have been subjected to an inhibitor. In some embodiments, the inhibitor is an inhibitor of a cellular factor or a plurality of factors that participates in a signaling cascade in the cell. In some embodiments, the inhibitor is a phosphatase inhibitor. Examples of phosphatase inhibitors include, but are not limited to H 2 O 2 , siRNA, miRNA, Cantharidin, (−)-p-Bromotetramisole, Microcystin LR, Sodium Orthovanadate, Sodium Pervanadate, Vanadyl sulfate, Sodium oxodiperoxo(1,10-phenanthroline)vanadate, bis(maltolato)oxovanadium(IV), Sodium Molybdate, Sodium Perm olybdate, Sodium Tartrate, Imidazole, Sodium Fluoride, 13-Glycerophosphate, Sodium Pyrophosphate Decahydrate, Calyculin A, Discodermia calyx, bpV(phen), mpV(pic), DMHV, Cypermethrin, Dephostatin, Okadaic Acid, NIPP-1, N-(9,10-Dioxo-9,10-dihydro-phenanthren-2-yl)-2,2-dimethyl-propionamide, α-Bromo-4-hydroxyacetophenone, 4-Hydroxyphenacyl Br, α-Bromo-4-methoxyacetophenone, 4-Methoxyphenacyl Br, α-Bromo-4-(carboxymethoxy)acetophenone, 4-(Carboxymethoxy)phenacyl Br, and bis(4-Trifluoromethylsulfonamidophenyl)-1,4-diisopropylbenzene, phenylarsine oxide, Pyrrolidine Dithiocarbamate, and Aluminium fluoride. In some embodiments, the phosphatase inhibitor is H 2 O 2 . 
     In some embodiments, the methods of the invention provide methods for classifying a cell population or determining the presence or absence of a condition in an individual by subjecting a cell from the individual to a modulator and an inhibitor, determining the activation level of an activatable element in the cell, and determining the presence or absence of a condition based on the activation level. In some embodiments, the activation level of a plurality of activatable elements in the cell is determined. The inhibitor can be an inhibitor as described herein. In some embodiments, the inhibitor is a phosphatase inhibitor. In some embodiments, the inhibitor is H 2 O 2 . The modulator can be any modulator described herein. In some embodiments, the methods of the invention provides for methods for classifying a cell population by exposing the cell population to a plurality of modulators in separate cultures and determining the status of an activatable element in the cell population. In some embodiments, the status of a plurality of activatable elements in the cell population is determined. In some embodiments, at least one of the modulators of the plurality of modulators is an inhibitor. The modulator can be at least one of the modulators described herein. In some embodiments, at least one modulator is selected from the group consisting of SDF-1α, IFN-α, IFN-γ, IL-10, IL-6, IL-27, G-CSF, FLT-3L, IGF-1, M-CSF, SCF, PMA, Thapsigargin, H 2 O 2 , Etoposide, Mylotarg, AraC, daunorubicin, staurosporine, benzyloxycarbonyl-Val-Ala-Asp (OMe) fluoromethylketone (ZVAD), lenalidomide, EPO, azacitadine, decitabine, IL-3, IL-4, GM-CSF, EPO, LPS, TNF-α, and CD40L or a combination thereof. In some embodiments of the invention, the status of an activatable element is determined by contacting the cell population with a binding element that is specific for an activation state of the activatable element. In some embodiments, the status of a plurality of activatable elements is determined by contacting the cell population with a plurality of binding elements, where each binding element is specific for an activation state of an activatable element. 
     In some embodiments, the methods of the invention provide methods for determining a phenotypic profile of a population of cells by exposing the population of cells to a plurality of modulators (recited herein) in separate cultures, determining the presence or absence of an increase in activation level of an activatable element in the cell population from each of the separate cultures and classifying the cell population based on the presence or absence of the increase in the activation of the activatable element from each of the separate culture. In some embodiments, the phenotypic profile is used to characterize multiple pathways in the population of cells. 
     Patterns and profiles of one or more activatable elements are detected using the methods known in the art including those described herein. In some embodiments, patterns and profiles of activatable elements that are cellular components of a cellular pathway or a signaling pathway are detected using the methods described herein. For example, patterns and profiles of one or more phosphorylated polypeptides are detected using methods known in art including those described herein. 
     In some embodiments, cells (e.g. normal cells) other than the cells associated with a condition (e.g. cancer cells) or a combination of cells are used, e.g., in assigning a risk group, predicting an increased risk of relapse, predicting an increased risk of developing secondary complications, choosing a therapy for an individual, predicting response to a therapy for an individual, determining the efficacy of a therapy in an individual, and/or determining the prognosis for an individual. That is that cells other than cells associated with a condition (e.g. cancer cells) are in fact reflective of the condition process. For instance, in the case of cancer, infiltrating immune cells might determine the outcome of the disease. Alternatively, a combination of information from the cancer cell plus the immune cells in the blood that are responding to the disease, or reacting to the disease can be used for diagnosis or prognosis of the cancer. See U.S. Ser. No. 61/499,127 and PCT/US2011/01565 (incorporated by reference in its entirety) for a comparison to normal cells. 
     In some embodiments, the invention provides methods to carry out multiparameter flow cytometry for monitoring phospho-protein responses to various factors in acute myeloid leukemia at the single cell level. Phospho-protein members of signaling cascades and the kinases and phosphatases that interact with them are required to initiate and regulate proliferative signals in cells. Apart from the basal level of protein phosphorylation alone, the effect of potential drug molecules on these network pathways was studied to discern unique cancer network profiles, which correlate with the genetics and disease outcome. Single cell measurements of phospho-protein responses reveal shifts in the signaling potential of a phospho-protein network, enabling categorization of cell network phenotypes by multidimensional molecular profiles of signaling. See U.S. Pat. No. 7,393,656. See also Irish et. al., Single cell profiling of potentiated phospho-protein networks in cancer cells. Cell. 2004, vol. 118, p. 1-20. 
     Flow cytometry is useful in a clinical setting, since relatively small sample sizes, as few as 10,000 cells, can produce a considerable amount of statistically tractable multidimensional signaling data and reveal key cell subsets that are responsible for a phenotype. See U.S. Ser. No. 12/432,720. 
     Cytokine response panels have been studied to survey altered signal transduction of cancer cells by using a multidimensional flow cytometry file which contained at least 30,000 cell events. In one embodiment, this panel is expanded and the effect of growth factors and cytokines on primary AML samples studied. See U.S. Pat. Nos. 7,381,535 and 7,393,656. See also Irish et. al., CELL July 23; 118(2):217-28. In some embodiments, the analysis involves working at multiple characteristics of the cell in parallel after contact with the compound. For example, the analysis can examine drug transporter function; drug transporter expression; drug metabolism; drug activation; cellular redox potential; signaling pathways; DNA damage repair; and apoptosis. 
     In some embodiments, the modulators include growth factors, cytokines, chemokines, phosphatase inhibitors, and pharmacological reagents. The response panel is composed of at least one of: SDF-1α, IFN-α, IFN-γ, IL-10, IL-6, IL-27, G-CSF, FLT-3L, IGF-1, M-CSF, SCF, PMA, Thapsigargin, H 2 O 2 , Etoposide, Mylotarg, AraC, daunorubicin, staurosporine, benzyloxycarbonyl-Val-Ala-Asp (OMe) fluoromethylketone (ZVAD), lenalidomide, EPO, azacitadine, decitabine, IL-3, IL-4, GM-CSF, EPO, LPS, TNF-α, and CD40L. 
     The response of each phospho-protein node is compared to the basal state and can be represented by calculating the log 2  fold difference in the Median Fluorescence Intensity (MFI) of the stimulated sample divided by the unstimulated sample. The data can be analyzed using any of the metrics described herein including the metric described in  FIGS. 2A-2B . However, other statistical methods may be used. The growth factor and the cytokine response panel included detection of phosphorylated Stat1, Stat3, Stat5, Stat6, PLCγ2, S6, Akt, Erk1/2, CREB, p38, and NF-KBp-65. In some embodiments, a diagnosis, prognosis, a prediction of outcome such as response to treatment or relapse is performed by analyzing the two or more phosphorylation levels of two or more proteins each in response to one or more modulators. The phosphorylation levels of the independent proteins can be measured in response to the same or different modulators. Grouping of data points increases predictive value. 
     In some embodiments, the AML panel of modulators is further expanded to examine the process of DNA damage, apoptosis, drug transport, drug metabolism, and the use of peroxide to evaluate phosphatase activity. Analysis can assess the ability of the cell to undergo the process of apoptosis after exposure to the experimental drug in an in vitro assay as well as how quickly the drug is exported out of the cell or metabolized. The drug response panel can include but is not limited to detection of phosphorylated Chk2, Cleaved Caspase 3, Caspase 8, cleaved PARP and mitochondria-released Cytoplasmic Cytochrome C. Modulators may include Stauro, Etoposide, Mylotarg, AraC, and daunorubicin. Analysis can assess phosphatase activity after exposure of cells to phosphatase inhibitors including but not limited to hydrogen peroxide (H 2 O 2 ), H 2 O 2 +SCF and H 2 O 2 +IFNα. The response panel to evaluate phosphatase activity can include but is not limited to the detection of phosphorylated Slp76, PLCg2, Lck, S6, Akt, Erk, Stat1, Sta3, and Stat5. Later, the samples may be analyzed for the expression of drug transporters such as MDR1/PGP, MRP1 and BCRP/ABCG2. Samples may also be examined for XIAP, Survivin, Bcl-2, MCL-1, Bim, Ki-67, Cyclin D1, ID1 and Myc. 
     Another method of the present invention is a method for determining the prognosis and therapeutic selection for an individual with AML. Using the signaling nodes and methodology described herein, multiparametric flow could separate a patient into “cytarabine responsive”, meaning that a cytarabine based induction regimen would yield a complete response or “cytarabine non-responsive”, meaning that the patient is unlikely to yield a complete response to a cytarabine based induction regimen. Furthermore, for those patients unlikely to benefit from cytarabine based therapy, the individual&#39;s blood or marrow sample could reveal signaling biology that corresponds to either in-vivo or in-vitro sensitivity to a class of drugs including but not limited to direct drug resistance modulators, anti-Bcl-2 or pro-apoptotic drugs, proteosome inhibitors, DNA methyl transferase inhibitors, histone deacetylase inhibitors, anti-angiogenic drugs, farnesyl transferase inhibitors, FLt3 ligand inhibitors, or ribonucleotide reductase inhibitors. An individual with AML with a complete response to induction therapy could further benefit from the present invention. The individual&#39;s blood or marrow sample could reveal signaling biology that corresponds to likelihood of benefit from further cytarabine based chemotherapy versus myeloablative therapy followed by and stem cell transplant versus reduced intensity therapy followed by stem cell transplantation. 
     In some embodiments, the invention provides a method for diagnosing, prognosing, determining progression, predicting response to treatment or choosing a treatment for AML in an individual where the individual has a predefined clinical parameter, the method comprising the steps of (a) subjecting a cell population from the individual to a plurality of distinct modulators in separate cultures, (b) characterizing a plurality of pathways in one or more cells from the separate cultures comprising determining an activation level of at least one activatable element in at least three pathways, where (i) the pathways are selected from the group consisting of apoptosis, cell cycle, signaling, or DNA damage pathways (ii) at least one of the pathways being characterized in at least one of the separate cultures is an apoptosis or DNA damage pathway, (iii) the distinct modulators independently activate or inhibit said one or more pathways being characterized, and (c) correlating the characterization with diagnosing, prognosing, determining progression, predicting response to treatment or choosing a treatment for AML in an individual, where the pathways characterization in combination with the clinical parameter is indicative of the diagnosing, prognosing, determining progression, response to treatment or the appropriate treatment for AML, MDS or MPN. Examples of predetermined clinical parameters include, but are not limited to, age, de novo acute myeloid leukemia patient, secondary acute myeloid leukemia patient, or a biochemical/molecular marker. In some embodiments, the individual is over 60 years old. In some embodiments, the individual is under 60 years old. In some embodiments the activatable elements and modulators are selected from the activatable elements and modulators listed in Tables 1, 1(a)-1(e), 2, 3 or 5. In some embodiments, the activatable elements and modulators are selected from the activatable elements and modulators listed in Table 12 and are used to predict response duration in an individual after treatment. In some embodiments the modulator is selected from the group consisting of FLT3L, GM-CSF, SCF, G-CSF, SDF1a, LPS, PMA, Thapsigargin, IFNg, IFNa, IL-27, IL-3, IL-6, IL-10, ZVAD, H 2 O 2 , Staurosporine, Etoposide, Mylotarg, Daunorubicin, and AraC. In some embodiments, when the individual is under 60 years old the activatable elements and modulators are selected from the activatable elements and modulators listed in Table 6. In some embodiments, where the individual is over 60 years the activatable elements and modulators are selected from the activatable elements and modulators listed in Table 7. In some embodiments, where the individual is a secondary acute myeloid leukemia patient the activatable elements and modulators are selected from the activatable elements and modulators listed in Table 8 and Table 9. In some embodiments, where the individual is a de novo acute myeloid leukemia patient the activatable elements and modulators are selected from the activatable elements and modulators listed in Table 10 and Table 11. In some embodiments, where the individual has a wild type FLT3 the activatable elements and modulators are selected from the activatable elements and modulators listed in Table 13. 
     In some embodiments, the invention provides a method for predicting a response to a treatment or choosing a treatment for AML in an individual, the method comprising the steps: (a) subjecting a cell population from the individual to at least two distinct modulators in separate cultures; (b) determining an activation level of at least one activatable element from each of at least three pathways selected from the group consisting of apoptosis, cell cycle, signaling, and DNA damage pathways in one or more cells from each said separate cultures, where at least one of the activatable elements is from an apoptosis or DNA damage pathway, and where the activatable elements measured in each separate culture are the same or the activatable elements measured in each separate culture are different; and (c) predicting a response to a treatment or choosing a therapeutic for AML in the individual based on the activation level of said activatable elements. In some embodiments, the method further comprises determining whether the apoptosis, cell cycle, signaling, or DNA damage pathways are functional in the individual based on the activation levels of the activatable elements, wherein a pathway is functional if it is permissive for a response to a treatment, where if the apoptosis, cell cycle, signaling, and DNA damage pathways are functional the individual can respond to treatment, and where if at least one of the pathways is not functional the individual can not respond to treatment. In some embodiments, the method further comprises determining whether the apoptosis, cell cycle, signaling, or DNA damage pathways are functional in the individual based on the activation levels of the activatable elements, wherein a pathway is functional if it is permissive for a response to a treatment, where if the apoptosis and DNA damage pathways are functional the individual can respond to treatment. In some embodiments, the method further comprises determining whether the apoptosis, cell cycle, signaling, or DNA damage pathways are functional in the individual based on the activation levels of the activatable elements, wherein a pathway is functional if it is permissive for a response to a treatment, where a therapeutic is chosen depending of the functional pathways in the individual. In some embodiments the activatable elements and modulators are selected from the activatable elements and modulators listed in Tables 1, 2, 3 or 5. In some embodiments, the activatable elements and modulators are selected from the activatable elements and modulators listed in Table 12 and are used to predict response duration in an individual after treatment. In some embodiments the modulator is selected from the group consisting of FLT3L, GM-CSF, SCF, G-CSF, SDF1a, LPS, PMA, Thapsigargin, IFNg, IFNa, IL-27, IL-3, IL-6, IL-10, ZVAD, H 2 O 2 , Staurosporine, Etoposide, Mylotarg, Daunorubicin, and AraC. 
     In some embodiments, the invention provides a method of predicting a response to a treatment or choosing a treatment for AML in an individual, the method comprising the steps of: (a) subjecting a cell population from said individual to at least three distinct modulators in separate cultures, wherein: (i) a first modulator is a growth factor or mitogen, (ii) a second modulator is a cytokine, (iii) a third modulator is a modulator that slows or stops the growth of cells and/or induces apoptosis of cells or, the third modulator is an inhibitor; (b) determining the activation level of at least one activatable element in one or more cells from each of the separate cultures, where: (i) a first activatable element is an activatable element within the PI3K/AKT, or MAPK pathways and the activation level is measured in response to the growth factor or mitogen, (ii) a second activatable element is an activatable element within the STAT pathway and the activation level is measured in response to the cytokine, (iii) a third activatable element is an activatable element within an apoptosis pathway and the activation level is measured in response to the modulator that slows or stops the growth of cells and/or induces apoptosis of cells, or the third activatable element is activatable element within the phospholipase C pathway and the activation level is measured in response to the inhibitor, or the third activatable element is a phosphatase and the activation level is measured in response to the inhibitor; and (c) correlating the activation levels of said activatable elements with a response to a treatment or with choosing a treatment for AML in the individual. Examples of predefined clinical parameters include age, de novo acute myeloid leukemia patient, secondary acute myeloid leukemia patient, or a biochemical/molecular marker. In some embodiments, the cytokine is selected from the group consisting of G-CSF, IFNg, IFNa, IL-27, IL-3, IL-6, and IL-10. In some embodiments, the growth factor is selected from the group consisting of FLT3L, SCF, G-CSF, and SDF1a. In some embodiments, the mitogen is selected from the group consisting of LPS, PMA, and Thapsigargin. In some embodiments, the modulator that slows or stops the growth of cells and/or induces apoptosis of cells is selected from the group consisting of Staurosporine, Etoposide, Mylotarg, Daunorubicin, and AraC. 
     In some embodiments, activation levels of an activatable element within the STAT pathway higher than a threshold level in response to a cytokine are indicative that an individual can not respond to treatment. In some embodiment, a treatment is chosen based on the ability of the cells to respond to treatment. In some embodiments, the activatable element within the STAT pathway is selected from the group consisting of p-Stat3, p-Stat5, p-Stat1, and p-Stat6 and the cytokine is selected from the group consisting of IFNg, IFNa, IL-27, IL-3, IL-6, IL-10, and G-CSF. In some embodiments, the activatable element within the STAT pathway is Stat 1 and the cytokine is IL-27 or G-CSF. 
     In some embodiments, activation levels of an activatable element within the PI3K/AKT, or MAPK pathway higher than a threshold level in response to a growth factor or mitogen is indicative that an individual can not respond to treatment. In some embodiment, a treatment is chosen based on the ability of the cells to respond to treatment with a modulator. In some embodiments, the activatable element within the PI3K/AKT, or MAPK pathway is selected from the group consisting of p-ERK, p38 and pS6 and the growth factor or mitogen is selected from the group consisting of FLT3L, SCF, G-CSF, SDF1a, LPS, PMA, and Thapsigargin. 
     In some embodiments, activation levels of an activatable element within the phospholipase C pathway higher than a threshold level in response to an inhibitor is indicative that an individual can respond to treatment. In some embodiment, a treatment is chosen based on the ability of the cells to respond to treatment. In some embodiments, the activatable element within the phospholipase C pathway is selected from the group consisting of p-Slp-76, and Plcg2 and the inhibitor is H 2 O 2 . 
     In some embodiments, activation levels, of an activatable element within the apoptosis pathway, higher than a threshold in response to a modulator that slows or stops the growth of cells and/or induces apoptosis of cells is indicative that an individual can respond to treatment. In some embodiment, a treatment is chosen based on the ability of the cells to respond to treatment. In some embodiments, the activatable element within the apoptosis pathway is selected from the group consisting of Parp+, Cleaved Caspase 8, and Cytoplasmic Cytochrome C, and the modulator that slows or stops the growth of cells and/or induces apoptosis of cells is selected from the group consisting of Staurosporine, Etoposide, Mylotarg, Daunorubicin, and AraC. 
     In some embodiments, activation levels of an activatable element within the apoptosis pathway higher than a threshold in response to a modulator that slows or stops the growth of cells and/or induces apoptosis of cells and activation levels of an activatable element within the STAT pathway higher than a threshold level in response to a cytokine is indicative that an individual can not respond to treatment. In some embodiments, the activatable element within the apoptosis pathway is selected from the group consisting of Cleaved PARP, Cleaved Caspase 8, and Cytoplasmic Cytochrome C, and the modulator that slows or stops the growth of cells and/or induces apoptosis of cells is selected from the group consisting of Staurosporine, Etoposide, Mylotarg, Daunorubicin, and AraC. In some embodiments, the activatable element within the STAT pathway is selected from the group consisting of p-Stat3, p-Stat5, p-Stat1, and p-Stat6 and the cytokine is selected from the group consisting of IFNg, IFNa, IL-27, IL-3, IL-6, IL-10, and G-CSF. In some embodiments, the activatable element within the STAT pathway is Stat 1 and the cytokine is IL-27 or G-CSF. 
     In some embodiments, the methods of the invention further comprise determining an activation level of an activatable element within a DNA damage pathway in response to a modulator that slows or stops the growth of cells and/or induces apoptosis of cells. In some embodiments, the activatable element within a DNA damage pathway is selected from the group consisting of Chk2, ATM, ATR and 14-3-3 and the modulator that slows or stops the growth of cells and/or induces apoptosis of cells is selected from the group consisting of Staurosporine, Etoposide, Mylotarg, Daunorubicin, and AraC. 
     In some embodiments, activation levels higher than a threshold of an activatable element within a DNA damage pathway and activation levels lower than a threshold of an activatable element within the apoptosis pathway in response to a modulator that slows or stops the growth of cells and/or induces apoptosis of cells are indicative of a communication breakdown between the DNA damage response pathway and the apoptotic machinery and that an individual can not respond to treatment. In some embodiment, a treatment is chosen based on the ability of the cells to respond to treatment. 
     In some embodiments, the methods of the invention further comprise determining an activation level of an activatable element within a cell cycle pathway in response to a modulator that slows or stops the growth of cells and/or induces apoptosis of cells. In some embodiments, the activatable element within a DNA damage pathway is selected from the group consisting of Cdc25, p53, CyclinA-Cdk2, CyclinE-Cdk2, CyclinB-Cdk1, p21, and Gadd45 and the modulator that slows or stops the growth of cells and/or induces apoptosis of cells is selected from the group consisting of Staurosporine, Etoposide, Mylotarg, Daunorubicin, and AraC. 
     In some embodiments, the methods of the invention further comprise determining the levels of a drug transporter and/or a cytokine receptor. In some embodiments, the cytokine receptors or drug transporters are selected from the group consisting of MDR1, ABCG2, MRP, P-Glycoprotein, CXCR4, FLT3, and c-kit. In some embodiments, levels higher than a threshold of the drug transporter and/or said cytokine receptor are indicative that an individual can not respond to treatment. In some embodiment, a treatment is chosen based on the ability of the cells to respond to treatment. 
     In some embodiments, the methods of the invention further comprise determining the activation levels of an activatable element within the Akt pathway in response to an inhibitor, where activation levels higher that a threshold of the activatable element within the Akt pathway in response to the inhibitor are indicative that the individual can not respond to treatment. In some embodiment, a treatment is chosen based on the ability of the cells to respond to treatment. 
     In some embodiments, activation levels higher than a threshold of an activatable element in the PI3K/AKT pathway in response to a growth factor is indicative that the individual can not respond to treatment. In some embodiments, the activatable element in the PI3K/Akt pathway is Akt and the growth factor is FLT3L. 
     In some embodiments, activation levels higher than a threshold of an activatable element in the apoptosis pathway in response to a modulator that slows or stops the growth of cells and/or induces apoptosis of cells is indicative that the individual can respond to treatment. In some embodiments, the activatable element within the apoptosis pathway is Parp+ and the modulator that slows or stops the growth of cells and/or induces apoptosis of cells is selected from the group consisting of Staurosporine, Etoposide, Mylotarg, Daunorubicin, and AraC. 
     In some embodiments, the invention provides a method of predicting a response to a treatment or choosing a treatment for AML in an individual where the individual is a secondary acute myeloid leukemia patient, the method comprising the steps of; (a) subjecting a cell population from the individual to IL-27 and G-CSF in separate cultures, (b) determining an activation level of pStat1 in one or more cells from each separate culture, (c) predicting a response to a treatment or choosing a treatment for AML, in the individual, where if the activation levels of pStat1 are higher than a threshold level in response to both IL-27 and G-CSF the individual can not respond to treatment and if the levels of pStat1 are lower than a threshold in response to both IL-27 and G-CSF the individual can respond to treatment. In some embodiments, the treatment is a chemotherapy agent. Examples of chemotherapy agents include, but are not limited to, cytarabine (ara-C), daunorubicin (Daunomycin), idarubicin (Idamycin), mitoxantrone and 6-thioguanine. In some embodiments, the treatment is allogeneic stem cell transplant or autologous stem cell transplant. 
     In some embodiments, the invention provides a method of predicting a response to a treatment or choosing a treatment for AML in an individual, the method comprising the steps of: (a) subjecting a cell population from the individual to FLT3L, (b) determining an activation level of pAkt in one or more cells from the population (c) predicting a response to a treatment or choosing a treatment for AML in the individual, where if the activation levels of pAkt are higher than a predetermined threshold in response to FLT3L the individual can not respond to treatment. In some embodiments, the method further comprises the steps of: (d) subjecting a cell population from said individual to IL-27 in a separate culture, (e) determining an activation level of Stat1 in one or more cells from the separate culture, (f) predicting a response to a treatment or choosing a treatment for AML in the individual, where if the activation levels of pStat1 are higher than a predetermined threshold in response to IL-27 the individual can not respond to treatment. In some embodiments where the individual is over 60 years old the method further comprises the step of: (g) subjecting a cell population from the individual to H 2 O 2  in a separate culture, (h) determining an activation level of Plcg2 in one or more cells from the separate culture (i) predicting a response to a treatment or choosing a treatment for AML in the individual, wherein if the activation levels of Plcg2 are higher than a predetermined threshold in response to H 2 O 2  the individual can not respond to treatment. In some embodiments where the individual is under 60 years old the method further comprises the steps of (g) subjecting a cell population from said individual to Etoposide in a separate culture, (h) determining an activation level of Parp in one or more cells from the separate culture, and (i) predicting a response to a treatment for AML in said individual, where if the activation levels of Parp are higher than a predetermined threshold in response to Etoposide the individual can respond to treatment. In some embodiments, the treatment is a chemotherapy agent. Examples are shown above. 
     In some embodiments, the invention provides methods of prediction response to a treatment and/or risk of relapse for AML in an individual, the method comprising the steps of: (a) subjecting a cell population from the individual to a modulator in the Tables 1(a) to 1(e) below, (b) determining an activation level of an activatable element in one or more cells from the population (c) predicting a response to a treatment, choosing a treatment or predicting risk of relapse for AML in the individual, where if the activation levels of the activatable elements are higher than a predetermined threshold in response to the modulator the individual can not respond to treatment or will have a higher probability of relapse. 
     In some embodiments, a diagnosis, prognosis, a prediction of outcome such as response to treatment or relapse is performed by analyzing the two or more phosphorylation levels of two or more proteins each in response to one or more modulators. The phosphorylation levels of the independent proteins can be measured in response to the same or different modulators. Grouping of data points increases predictive value. 
     In some embodiments, the invention provides a method of diagnosing, prognosing or predicting a response to a treatment or choosing a treatment for AML in an individual, the method comprising the steps of: (a) subjecting a cell population from the individual in separate cultures to at least two modulators listed in 1a to 1e below; b) determining the activation level of at least three activatable elements listed in Tables 1(a) to 1(e) below; and (c) diagnosing, prognosing, or predicting a response to a treatment or choosing a treatment for AML based on the activation levels of the activatable elements. In some embodiments, the method further comprises determining the expression of a cytokine receptor or drug transporter selected from the group consisting of MDR1, ABCG2, MRP, P-Glycoprotein, CXCR4, FLT3, and c-Kit. 
     In some embodiments, the invention provides methods of diagnosing, prognosing, determining progression, predicting a response to a treatment or choosing a treatment for acute leukemia in an individual, the methods comprising the steps of: (1) classifying one or more hematopoietic cells associated with acute leukemia, in the individual by a method comprising: a) subjecting a cell population comprising the one or more hematopoietic cells from the individual to a modulator listed in Tables 1(a) to 1(e) below, b) determining an activation level of at least one activatable element selected from the group listed in Tables 1(a) to 1(e) below in one or more cells from the individual, and c) classifying the one or more hematopoietic cells based on the activation levels of the activatable element; and (2) making a decision regarding a diagnosis, prognosis, progression, response to a treatment or a selection of treatment for acute leukemia in the individual based on the classification of said one or more hematopoietic cells. Additionally, in some embodiments the patients will be over 60 years old and in some embodiments the patients will have intermediate or high risk cytogenetics. 
     
       
         
           
               
               
             
               
                 TABLE 1(a) 
               
               
                   
               
               
                 Modulator  
                 Activatable Element 
               
               
                   
               
             
            
               
                 SCF  
                 AKT, S6  
               
               
                 at least two modulators selected from the  
                 of p-Slp-76, p-Plcg2, p-Stat3, p-Stat5, p-Stat1,  
               
               
                 group consisting of Staurosporine, Etoposide,  
                 p-Stat6, p-Creb, Parp+, Chk2, p-65/RelA, p-Akt,  
               
               
                 Mylotarg, Daunorubicin, AraC, CD40L,  
                 p-S6, p-ERK, Cleaved Caspase 8, Cytoplasmic  
               
               
                 G-CSF, IGF-1, IFNg, IFNa, IL-27, IL-3,  
                 Cytochrome C, and p38;  
               
               
                 IL-6, IL-10, FLT3L, SCF, G-CSF, SDF1a,  
                   
               
               
                 LPS, PMA, Thapsigargin and H 2 O 2    
                   
               
               
                 CD40L  
                 p-CREB and p-Erk  
               
               
                 FLT3L  
                 p-CREB, p-plcγ2, p-Stat5, p-Erk, p-Akt and p-S6  
               
               
                 G-CSF  
                 p-Stat 3, and p-Stat 5  
               
               
                 H 2 O 2  and SCF  
                 p-Erk, p-plcγ2, and p-SLP 76  
               
               
                 H 2 O 2    
                 p-Lck  
               
               
                 IGF-1  
                 p-CREB, and p-plcγ2  
               
               
                 IL-27, IL-3 or IL-6  
                 p-CREB and p-Stat 3  
               
               
                 M-CSF  
                 p-plcγ2, p-Akt and p-CREB  
               
               
                 none  
                 p-CREB, p-Erk, p-plcγ2, p-Stat 3, and p-Stat 6  
               
               
                 SCF  
                 p-CREB, and p-plcγ2  
               
               
                 SDF-1α and TNFα,  
                 p-Erk  
               
               
                 Thapsigargin  
                 p-CREB  
               
               
                 a modulator as listed in Tables 23 or 24  
                 (i) p-Akt in the presence of SCF, (ii) p-Akt in  
               
               
                   
                 the presence of FLT3L, (iii) p-Chk2 in the  
               
               
                   
                 presence of Etoposide; (iv) c-PARP+ in the  
               
               
                   
                 presence of no modulator and (v) p-Erk 1/2 in 
               
               
                   
                 the presence of PMA  
               
               
                 FIG. 36  
                 &gt;2, apoptosis  
               
               
                 PMA  
                 p-Erk 1/2 
               
               
                   
               
            
           
         
       
     
     
       
         
           
               
             
               
                 TABLE 1(b) 
               
             
            
               
                   
               
               
                 De Novo patients  
               
            
           
           
               
               
            
               
                 Modulator  
                 Activatable element 
               
               
                   
               
               
                 SCF or FLT3L (with a FLT3 mutation  
                 p-S6, and p-plcγ2  
               
               
                 Etoposide  
                 p-Chk2  
               
               
                 FLT3L  
                 p-plcγ2  
               
               
                 IL-3  
                 p-Stat 3  
               
               
                 IL-6  
                 p-Stat 5  
               
               
                 None  
                 p-Erk, and p-Stat 6  
               
               
                 SDF-1α,  
                 p-CREB  
               
               
                 Etoposide  
                 p-Chk2, and c-PARP  
               
               
                 G-CSF  
                 p-Stat1, p-Stat 3 and p-Stat 5  
               
               
                 None  
                 p-Chk2, and c-PARP  
               
               
                 PMA  
                 p-CREB  
               
               
                 H 2 O 2    
                 p-Akt 
               
               
                   
               
            
           
         
       
     
     
       
         
           
               
             
               
                 TABLE 1(c) 
               
             
            
               
                   
               
               
                 Patients over 60 years old  
               
            
           
           
               
               
            
               
                 Modulator  
                 Activatable element 
               
               
                   
               
               
                 IL-27  
                 p-Stat 3  
               
               
                 LPS  
                 p-Erk  
               
               
                 Daunorubicin, AraC, Etoposide and a  
                 p-Chk2, and c-PARP  
               
               
                 combination thereof  
                   
               
               
                 GM-CSF, IFNa, IFNg, IL-10 and IL-6  
                 p-Stat 1, p-Stat 3, and p-Stat 5  
               
               
                 None  
                 c-PARP, and p-Erk  
               
               
                 PMA and Thapsigargin  
                 p-CREB, and p-Erk  
               
               
                 Staurosporine, ZVAD and a combination  
                 cytochrome C, and c-PARP  
               
               
                 thereof 
               
               
                   
               
            
           
         
       
     
     
       
         
           
               
             
               
                 TABLE 1(d) 
               
             
            
               
                   
               
               
                 Intermediate or high risk cytogenetics  
               
            
           
           
               
               
            
               
                 Modulator  
                 Activatable element 
               
               
                   
               
               
                 G-CSF, IFNα, IFNg, IL-10, IL-27 and  
                 p-Stat 1, p-Stat 3, and p-Stat 5  
               
               
                 IL-6 
                   
               
               
                 H 2 O 2    
                 p-Akt, and p-Slp 76  
               
               
                 FLT3L or SCF  
                 p-Akt  
               
               
                 SDF-1α,  
                 p-CREB  
               
               
                 FLT3L or PMA  
                 p-CREB  
               
               
                 Ara-C, Etoposide and Daunorubicin  
                 p-Chk2, and p-PARP  
               
               
                 FLT3L  
                 p-Erk 
               
               
                   
               
            
           
         
       
     
     
       
         
           
               
             
               
                 TABLE 1(e) 
               
             
            
               
                   
               
               
                 Patients with FLT3 mutation  
               
            
           
           
               
               
               
            
               
                   
                 Modulator  
                 Activatable element 
               
               
                   
                   
               
               
                   
                 FIG. 36  
                 &gt;4  
               
               
                   
                 G-CSF, IL-6, IFNα, GM-CSF, IFNg,  
                 p-Stat 1, p-Stat 3 or p-Stat 5  
               
               
                   
                 IL-10, or IL-27 
               
               
                   
                   
               
            
           
         
       
     
     In some embodiments, the invention provides methods for predicting response to a treatment for AML, MDS or MPN, wherein the positive predictive value (PPV) is higher than 60, 70, 80, 90, 95, or 99.9%. In some embodiments, the invention provides methods for predicting response to a treatment for AML, MDS or MPN, wherein the PPV is equal or higher than 95%. In some embodiments, the invention provides methods for predicting response to a treatment for AML, MDS or MPN, wherein the negative predictive value (NPV) is higher than 60, 70, 80, 90, 95, or 99.9%. In some embodiments, the invention provides methods for predicting response to a treatment for AML, MDS or MPN, wherein the NPV is higher than 85%. 
     In some embodiments, the invention provides methods for predicting risk of relapse at 2 years, wherein the PPV is higher than 60, 70, 80, 90, 95, or 99.9%. In some embodiments, the invention provides methods for predicting risk of relapse at 2 years, wherein the PPV is equal or higher than 95%. In some embodiments, the invention provides methods for predicting risk of relapse at 2 years, wherein the NPV is higher than 60, 70, 80, 90, 95, or 99.9%. In some embodiments, the invention provides methods for predicting risk of relapse at 2 years, wherein the NPV is higher than 80%. In some embodiments, the invention provides methods for predicting risk of relapse at 5 years, wherein the PPV is higher than 60, 70, 80, 90, 95, or 99.9%. In some embodiments, the invention provides methods for predicting risk of relapse at 5 years, wherein the PPV is equal or higher than 95%. In some embodiments, the invention provides methods for predicting risk of relapse at 5 years, wherein the NPV is higher than 60, 70, 80, 90, 95, or 99.9%. In some embodiments, the invention provides methods for predicting risk of relapse at 5 years, wherein the NPV is higher than 80%. In some embodiments, the invention provides methods for predicting risk of relapse at 10 years, wherein the PPV is higher than 60, 70, 80, 90, 95, or 99.9%. In some embodiments, the invention provides methods for predicting risk of relapse at 10 years, wherein the PPV is equal or higher than 95%. In some embodiments, the invention provides methods for predicting risk of relapse at 10 years, wherein the NPV is higher than 60, 70, 80, 90, 95, or 99.9%. In some embodiments, the invention provides methods for predicting risk of relapse at 10 years, wherein the NPV is higher than 80%. 
     In some embodiments, the p value in the analysis of the methods described herein is below 0.05, 04, 0.03, 0.02, 0.01, 0.009, 0.005, or 0.001. In some embodiments, the p value is below 0.001. Thus in some embodiments, the invention provides methods for diagnosing, prognosing, determining progression or predicting response for treatment of AML wherein the p value is below 0.05, 04, 0.03, 0.02, 0.01, 0.009, 0.005, or 0.001. In some embodiments, the p value is below 0.001. In some embodiments, the invention provides methods for diagnosing, prognosing, determining progression or predicting response for treatment of AML wherein the AUC value is higher than 0.5, 0.6, 07, 0.8 or 0.9. In some embodiments, the invention provides methods for diagnosing, prognosing, determining progression or predicting response for treatment of AML wherein the AUC value is higher than 0.7. In some embodiments, the invention provides methods for diagnosing, prognosing, determining progression or predicting response for treatment of AML wherein the AUC value is higher than 0.8. In some embodiments, the invention provides methods for diagnosing, prognosing, determining progression or predicting response for treatment of AML wherein the AUC value is higher than 0.9. 
     Another method of the present invention is a method for determining the prognosis and therapeutic selection for an individual with myelodysplasia or MDS. Using the signaling nodes and methodology described herein, multiparametric flow cytometry could separate a patient into one of five groups consisting of: “AML-like”, where a patient displays signaling biology that is similar to that seen in acute myelogenous leukemia (AML) requiring intensive therapy, “Epo-Responsive”, where a patient&#39;s bone marrow or potentially peripheral blood, shows signaling biology that corresponds to either in-vivo or in-vitro sensitivity to erythropoietin, “Lenalidomide responsive”, where a patient&#39;s bone marrow or potentially peripheral blood, shows signaling biology that corresponds to either in-vivo or in-vitro sensitivity to Lenalidomide, “Auto-immune”, where a patient&#39;s bone marrow or potentially peripheral blood, shows signaling biology that corresponds to sensitivity to cyclosporine A (CSA) and anti-thymocyte globulin (ATG). 
     In those cases where an individual is classified as “AML-like”, the individual&#39;s blood or marrow sample could reveal signaling biology that corresponds to either in-vivo or in-vitro sensitivity to cytarabine or to a class of drugs including but not limited to direct drug resistance modulators, anti-Bcl-2 or pro-apoptotic drugs, proteosome inhibitors, DNA methyl transferase inhibitors, histone deacetylase inhibitors, anti-angiogenic drugs, farnesyl transferase inhibitors, FLt3 ligand inhibitors, or ribonucleotide reductase inhibitors. 
     In some embodiments of the invention, different gating strategies can be used in order to analyze only blasts in the sample of mixed population after treatment with the modulator. These gating strategies can be based on the presence of one or more specific surface marker expressed on each cell type. In some embodiments, the first gate eliminates cell doublets so that the user can focus on singlets. The following gate can differentiate between dead cells and live cells and subsequent gating of live cells classifies them into blasts, monocytes and lymphocytes. A clear comparison can be carried out to study the effect of potential modulators, such as G-SCF on activatable elements in: ungated samples, blasts, monocytes, granulocytes and lymphocytes by using two-dimensional contour plot representations of Stat5 and Stat3 phosphorylation (x and Y axis) of patient samples. The level of basal phosphorylation and the change in phosphorylation in both Stat3 and Stat5 phosphorylation in response to G-CSF can be compared. G-CSF increases both STAT3 and STAT5 phosphorylation and this dual signaling can occur concurrently (subpopulations with increases in both pSTAT 3 and pSTAT5) or individually (subpopulations with either an increase in phospho pSTAT 3 or pSTAT5 alone). The advantage of gating is to get a clearer picture and more precise results of the effect of various activatable elements on blasts. 
     In some embodiments, a gate is established after learning from a responsive subpopulation. That is, a gate is developed from one data set. This gate can then be applied retrospectively or prospectively to other data sets (See  FIGS. 5, 6, and 7 ). The cells in this gate can be used for the diagnosis or prognosis of a condition. The cells in this gate can also be used to predict response to a treatment or for treatment selection. The mere presence of cells in this gate may be indicative of a diagnosis, prognosis, or a response to treatment. In some embodiments, the presence of cells in this gate at a number higher than a threshold number may be indicative of a diagnosis, prognosis, or a response to treatment. 
     Some methods of analysis, also called metrics are: 1) measuring the difference in the log of the median fluorescence value between an unstimulated fluorochrome-antibody stained sample and a sample that has not been treated with a stimulant or stained (log (MFI Unstimulated Stained )−log (MFI Gated Unstained )), 2) measuring the difference in the log of the median fluorescence value between a stimulated fluorochrome-antibody stained sample and a sample that has not been treated with a stimulant or stained (log (MFI Stimulated Stained )−log(MFI Gated Unstained )), 3) Measuring the change between the stimulated fluorochrome-antibody stained sample and the unstimulated fluorochrome-antibody stained sample log (MFI Stimulated Stained )−log (MFI Unstimulated Stained ), also called “fold change in median fluorescence intensity”, 4) Measuring the percentage of cells in a Quadrant Gate of a contour plot which measures multiple populations in one or more dimension 5) measuring MFI of phosphor positive population to obtain percentage positivity above the background; and 6) use of multimodality and spread metrics for large sample population and for subpopulation analysis. Other metrics used to analyze data are population frequency metrics measuring the frequency of cells with a described property such as cells positive for cleaved PARP (% PARP+), or cells positive for p-S6 and p-Akt (See  FIG. 2B ). Similarly, measurements examining the changes in the frequencies of cells may be applied such as the Change in % PARP+which would measure the % PARP+ Stimulated Stained −% PARP+ Unstimulated Stained . The AUC unstim  metric also measures changes in population frequencies measuring the frequency of cells to become positive compared to an unstimulated condition ( FIG. 2B ). The metrics described in  FIG. 2B  can be use to measure apoptosis. For example, these metrics can be applied to cleaved Caspase-3 and Caspase-8, e.g., Change in % Cleaved Caspase-3 or Cleaved Caspase-8. 
     Other possible metrics include third-color analysis (3D plots); percentage positive and relative expression of various markers; clinical analysis on an individual patient basis for various parameters, including, but not limited to age, race, cytogenetics, mutational status, blast percentage, CD34+ percentage, time of relapse, survival, etc. See  FIGS. 2A-2B . In alternative embodiments, there are other ways of analyzing data, such as third color analysis (3D plots), which can be similar to Cytobank 2D, plus third D in color. 
     Elderly AML 
     In certain embodiments, the invention provides methods and compositions related to acute myeloid leukemia (AML). In certain embodiments, the invention provides a test to determine whether or not, or the likelihood that, an AML patient, e.g., an elderly AML patient, such as described elsewhere herein, will respond to induction therapy, e.g., therapy including administration of ara C, generally in conjunction with an anthracycline, such as daunorubicin. The invention also provides kits for use in such a test. In particular embodiments, the invention relates to treating patients already diagnosed with AML, for example with standard induction therapy (i.e., a therapy that includes at least the administration of araC), on the basis of a test to determine likelihood of response to therapy, e.g., standard induction therapy. In certain embodiments, the invention relates to reviewing the results of the test and determining whether or not to treat a patient. In this invention, “likelihood of response to therapy” is likelihood of response immediately after therapy, e.g., likelihood of fewer than 5% blasts at the end of induction and no extramedullary blasts (EMB). 
     In certain embodiments, the test uses cells obtained from the patient, for example peripheral blood (PB) cells or bone marrow (BM) cells which are modulated, for example, with one or more apoptosis-inducing agents, and monitoring two or more, characteristics of the cells in response to the apoptosis-inducing agent or agents, where one of the characteristics is the level of a protein or other substance associated with apoptosis (a “marker”), such as an activatable element, in single cells. The second characteristic may be, e.g., a level of expression of another marker, e.g., a surface marker related to maturity of the cells, for example maturity of blasts, in single cells. In certain embodiments, the apoptosis-inducing agent is selected from the group consisting of etoposide, staurosporine, araC, daunorubicin, and combinations thereof. In certain embodiments, at least two apoptosis-inducing agents are used, for example, araC and duanorubicin. In certain embodiments the apoptosis marker is pChk2, p-H2AX, Bcl-2, cytochrome c, c-caspase 3, c-caspase 8, or cPARP (c stands for “cleaved”). cPARP is also designated “PARP+.” In certain embodiments, the marker of apoptosis is an activatable element selected from the group consisting of pChk2, p-H2AX, c-caspase 3, c-caspase 8, or cPARP. In certain embodiments, the marker of apoptosis is cPARP. In certain embodiments, the surface marker related to maturity is CD34. 
     In certain embodiments, the AML patient is an elderly patient, for example, a patient whose age is greater than (in some cases greater than or equal to) 55, 60, 65, or 69 at the time the test is performed. In certain embodiments, the patient is a non-M3 AML patient. The cells are prepared for the assay then modulated with the one or more apoptosis-inducing agents and allowed to incubate for a predetermined time, then they are exposed to a cocktail containing one or more detectable binding elements that each binds to a characteristics to be detected, e.g., apoptosis marker, surface marker; generally, the cocktail to which any given cell sample is exposed includes detectable binding elements specific to all of the two or more characteristics, for example, a binding element to an apoptosis marker and a binding element to a surface marker. The binding element may be an antibody, and may be detectable due to labeling, e.g., labeling with a fluorescent label or labeling with a mass tag (if detection is by mass cytometry). The binding of the binding element(s) in each cell is detected by any suitable detection method, for example, flow cytometry or mass cytometry. The signal detected will depend on the nature of the detector; for simplicity, it is described herein as fluorescence, as for a flow cytometer, but it will be appreciated that any detectable signal may be used, such as mass with a mass cytometer, and the analysis is essentially the same. Analysis of cells by flow cytometry or mass cytometry for characteristics such as surface markers and levels of activatable elements are known and described elsewhere herein. 
     Both the time of preparation of the cells and the time of incubation is important. Any suitable sample may be used, but generally samples are either cryopreserved or fresh. If a sample is cryopreserved, then it should be thawed and allowed to “rest” after thawing, for at least one hour and preferably for two hours. If a fresh sample is used, i.e., a sample that has not been frozen, the sample should be allowed to come to room temperature but the rest time may be shorter, e.g., less than two hours, or less than one hour, or less than 30 min, or no rest time may be required. 
     The time of incubation is important. If a marker of apoptosis that is relatively upstream is to be used, then shorter incubations may be desirable, e.g., 6-18, 6-20, 6-23 hours or even less than 6 hours. Such markers include pChk2, p-H2AX, Bcl-2, cytochrome c and the cleaved caspases, e.g., c-caspase 3 or c-caspase 8. If the marker of apoptosis is cPARP, which is relatively downstream, a longer incubation time may be desirable, e.g., 16-36 hours, such as 20-30 hours, or in certain embodiments 22-28 hours, for example, 24 hours. However, shorter time of incubation are acceptable even when using cPARP as a marker, such as 6-22 hours, or 6-20 hours, or 6-18 hours, or 6-16 hours, or 6-12 hours, or 6-10 hours, or 8-22 hours, or 8-20 hours, or 8-18 hours, or 8-16 hours, or 8-12 hours, or 8-10 hours, or 12-22 hours, or 12-20 hours, or 10-18 hours, or 10-16 hours, or 10-12 hours, or 12-22 hours, or 12-20 hours, or 12-18 hours, or 12-16 hours, or 14-22 hours, or 14-20 hours, or 14-18 hours, or 14-16 hours, or 16-22 hours, or 16-20 hours, or 16-18 hours, or 18-22 hours, or 18-20 hours, or 20-22 hours or 20-23 hours. In certain embodiments, the incubation time may be less than 6 hours when the marker is cPARP. At time periods longer than 24 hours, apoptosis may have progressed to the point where little or no meaningful data may be gathered, but in certain embodiments the incubation may be as long as 48 hour or even longer. Thus, in certain embodiments the incubation time may be 26-48 hours, or 26-42 hours, or 26-36 hours, or 26-30 hours, or 26-28 hours, or 28-48 hours, or 28-42 hours, or 28-36 hours, or 28-30 hours, or 30-48 hours, or 30-42 hours, or 30-36 hours, or 32-48 hours, or 32-42 hours, or 32-36 hours, or 34-48 hours, or 34-42 hours, or 34-36 hours, or 36-48 hours, or 36-42 hours, or 40-48 hours, or 42-48 hours. In certain embodiments, the incubation time may be longer than 48 hours. 
     The data for the cells from the patient is then gated to provide an estimate of viable cells in the original sample, then if the estimate is below a certain threshold value, for example, less than 15-50%, such as less than 20-40%, for example less than 20-30%, e.g., less than 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, or 30%, the test results are not calculated further and no prediction is made as to response or non-response to therapy, e.g., induction therapy. In certain embodiments the threshold is 25% viable cells. Alternatively, cells deemed to be non-viable, e.g., by some combination of scatter, Amine Aqua, and cPARP, may simply not be used in the analysis-however it will be appreciated that if the marker of apoptosis is cPARP, this approach cannot be taken. 
     One aspect of the invention is the manner in which viability is determined. The manner and order in which the cells are gated can be important to the results of the test, e.g., results of viability analysis. In certain embodiments, the gating is by side scatter and forward scatter (SSC and FSC) to eliminate cell debris, by Amine Aqua or other indicator of cell death and SSC to eliminate dead cells, by SSC and CD45 to select for blasts, and finally measures of the characteristics are taken (e.g., measure level of apoptosis and measure levels of immature blasts, CD34+. Other cell markers useful in the invention include CD11b and CD117). The measure of the apoptosis may be used in the preliminary viability gate; for example, cPARP levels as described in more detail herein. In certain embodiments, the gating is done in the order above. In certain embodiments, cells are gated for CD45+ before gating for Amine Aqua or other indicator of cell death. In certain embodiments, cells are first gated by side scatter and forward scatter (SSC and FSC) to eliminate cell debris, then by Amine Aqua or other indicator of cell death and SSC to eliminate dead cells, then by SSC and CD45 to select for blasts, and finally measures of the characteristics are taken (e.g., measure level of apoptosis and measure levels of immature blasts, CD34+). To determine viability (percent health or PH), PH=(number cells cPARP− in P1 blasts (determined by CD45 gating)/total intact cells)×100. The number of intact cells is determined in the first gate, i.e., FSC vs. SSC, whereas the number of cPARP− cells is determined only in P1 blasts, that is, after the third gate, i.e., CD45 vs. SSC. “cPARP−” cells are cells whose cPARP reading, e.g., fluorescence of a fluorescently-labeled antibody in flow cytometry, is below a certain predetermined threshold value. It will be appreciated that if the determination of viability is set too early, e.g., at FSC vs. SSC, or at Amine Aqua vs. SSC, cells will be included in the assay that are apoptotic or otherwise unhealthy or even dead, and if viability is set too late, e.g., after cPARP gating, then no meaningful data may be obtained. The position in the gating at which viability is determined, and the order of the gating are thus important and not easily determined. 
     If the viability gate is positive, the data is then analyzed to obtain a value that indicates the likelihood that the patient will respond to therapy, e.g., induction therapy. In some cases, the value is simply a threshold value, above which (or above or equal to) a patient is deemed to be responsive to therapy, e.g., induction therapy, and below which (or below or equal to) a patient is deemed to be non-responsive. However, in most cases the value can be interpreted to give a probability of response to therapy, with no strict cutoff, so that the patient and/or the patient&#39;s healthcare provider(s) may make an informed decision as to whether or not to go ahead with therapy, e.g., induction therapy. 
     The invention provides for at least two characteristics to be used in the calculation of the test value, where one of the characteristics is the level of an marker of apoptosis, for example, level of a phosphorylated protein or level of a cleaved protein, such as a protein associated with apoptosis, in single cells, e.g., a level of cPARP, and the second characteristic is a level of expression of a marker, e.g., a surface marker related to maturity of the cells, for example maturity of blasts, in single cells, e.g., a level of CD34. Without being bound by theory, it is thought that the apoptosis marker cPARP is an indicator that the one or more apoptosis-inducing agents have caused the cell to enter apoptosis, and if enough cells, e.g., blasts, from the patient show this characteristic, then the patient is more likely to be responsive to induction therapy. It is also thought that CD34 is another indication that the induction therapy will be successful that is relatively independent of apoptosis marker, that is, if after treatment with the one or more apoptosis-inducing agents the number of cells expressing CD34 (or expression above a certain threshold) decreases, this indicates a relative absence of immature blasts after the treatment (for example, immature blasts have been killed or rendered not viable by the treatment), and the patient will be more likely to respond to induction therapy. Other useful cell surface markers in this regard include CD11b and CD 117. In both cases the characteristic is compared to cells that have not been treated with the apoptosis-inducing agent or agents. Thus, in certain embodiments of the invention, the assay requires an early timepoint, e.g., 15 min, for cells that are untreated with apoptosis-inducing agents, then a later timepoint, e.g., 24 hours, or other suitable time as described herein, in which both untreated and apoptosis-inducing agent-treated cells are assayed. It is the change from the early timepoint to the late timepoint for each characteristic that is measured. Thus, there is an early timepoint and a later timepoint. The early timepoint may be a time in a range from 0 min to 120 min, or 0 min to 90 min, or 0 min to 60 min, or 0 min to 45 min, or 0 min to 30 min, or 0 min to 25 min, or 0 min to 20 min, or 0 min to 15 min, or 0 min to 12 min, or 0 min to 10 min, or 0 min to 8 min, or 0 min to 5 min, or 2 min to 120 min, or 2 min to 90 min, or 2 min to 60 min, or 2 min to 45 min, or 2 min to 30 min, or 2 min to 25 min, or 2 min to 20 min, or 2 min to 15 min, or 2 min to 12 min, or 2 min to 10 min, or 2 min to 8 min, or 2 min to 5 min, or 5 min to 120 min, or 5 min to 90 min, or 5 min to 60 min, or 5 min to 45 min, or 5 min to 30 min, or 5 min to 25 min, or 5 min to 20 min, or 5 min to 15 min, or 5 min to 12 min, or 5 min to 10 min, or 5 min to 8 min, or 8 min to 120 min, or 8 min to 90 min, or 8 min to 60 min, or 8 min to 45 min, or 8 min to 30 min, or 8 min to 25 min, or 8 min to 20 min, or 8 min to 15 min, or 8 min to 12 min, or 8 min to 10 min, or 10 min to 120 min, or 10 min to 90 min, or 10 min to 60 min, or 10 min to 45 min, or 10 min to 30 min, or 10 min to 25 min, or 10 min to 20 min, or 10 min to 15 min, or 15 min to 120 min, or 15 min to 90 min, or 15 min to 60 min, or 15 min to 45 min, or 15 min to 30 min, or 15 min to 25 min, or 15 min to 20 min, or 20 min to 120 min, or 20 min to 90 min, or 20 min to 60 min, or 20 min to 45 min, or 20 min to 30 min, or 20 min to 25 min, or 30 min to 120 min, or 30 min to 90 min, or 30 min to 60 min, or 30 min to 45 min. In any case, a first timepoint is taken, preferably in a sample that has not been treated with apoptosis-inducing agent or agents, and compared to a second timepoint for both untreated and treated cells, i.e., a total of three wells in, e.g., a 96-well plate (though other wells may be used as controls and for other reasons). The early timepoint is used as the sample to determine cell viability. 
     Any suitable metric may be used to express the change. Metrics are well-known and are described elsewhere herein. In certain embodiments, the Uu (Mann-Whitney) metric is used. Uu has a range from 0.5 (no change between two samples) to 1.0 (maximum increase in characteristic measured) or to 0 (maximum decrease in characteristic measured). Because the change in cPARP or other apoptosis marker that is associated with probable response to treatment will be greater than 0.5, the apoptosis marker is evaluated as (Uu-0.5) (see Table 48, Example 22), and if Uu is less than or equal to 0.5 it is set at 0. Because the change in the marker of cell maturity marker that is associated with probable response to treatment is a decrease in the marker, it is evaluated as (0.5-Uu) (see Table 48, Example 22), and if Uu is less than 0.5, the value is set at 0. Both values are squared because the best predictor of response is non-linear, and, more importantly, each value is associated with a coefficient to weight the value; it has been found that the increase in cPARP is strikingly more important than the decrease in CD34 in predicting response to induction therapy immediately post-induction, thus cPARP is given a relatively larger coefficient than CD34. In certain embodiments, the coefficient for the apoptosis marker, e.g., cPARP, is at 1.25 to 5 times greater than the coefficient for the marker for cell maturity, e.g., CD34, or 1.5-5 times greater, or 1.75-5 times greater, or 2-5 times greater, or 2.25-5 times greater, or 2.5-5 times greater, or 2.75-5 times greater, or 3-5 times greater, or 3.5-5 times greater, or 4-5 times greater, or 1.25-4 times greater, or 1.5-4 times greater, or 1.75-4 times greater, or 2-4 times greater, or 2.25-4 times greater, or 2.5-4 times greater, or 2.75-4 times greater, or 3-4 times greater, or 3.5-4 times greater, or 4-5 times greater, or 1.25-3.5 times greater, or 1.5-3.5 times greater, or 1.75-3.5 times greater, or 2-3.5 times greater, or 2.25-3.55 times greater, or 2.5-3.5 times greater, or 2.75-3.5 times greater, or 3-3.5 times greater, or, or 1.25-3 times greater, or 1.5-3.0 times greater or 1.75-3 times greater, or 2-3 times greater, or 2.25-3 times greater, or 2.5-3 times greater. A continuous score is then obtained as outlined for example in Table 48, Example 22, where χ′ is 0.9560 (Uu cPARP-0.5) 2 +0.3495 (0.5-Uu CD34) 2  and 3 is the vector of the regression coefficients so that the overall continuous score is a value between 0 to 1. Note that in this example the values are squared before being multiplied by the appropriate coefficient and in certain embodiments one or more of the values is squared. In certain embodiments, the decision to treat the patient is made by comparing this value to a threshold value, for example, 0.6 or similar value. In certain embodiments, the value is related to a probability of response to treatment and the probability is used to determine whether or not to treat the patient. 
     Other patient characteristics may be taken into account in the decision and, indeed, in the classifier itself. Such characteristics are described elsewhere herein. 
     It will be appreciated that either marker alone may be used to predict response, and in certain embodiments, only a marker of apoptosis, e.g., cPARP is used, after gating for viable cells; in certain embodiments, only a marker for cell maturity, e.g., CD34, may be used after gating for viable cells; however, the preferred embodiment is to use both markers, combined as above. 
     The test may also utilize one or more controls in order to ensure reliability. For example, in some embodiments, Rainbow Control Particles, as described in Example 22, are used in order to ensure cytometer reliability. In certain embodiments, one or more control cell lines are used, also as described in Example 22, as a control for the end-to-end process. In addition, lyophilized cells which have been treated with the appropriate modulator and known to contain certain levels of one or more elements, for example, activatable elements, may also be used to confirm that the test is measuring modulation properly. 
     In certain embodiments, the invention is directed to treating an elderly AML patient, such as a patient over 55 years old suffering from non-M3 AML by standard induction therapy, i.e., arac and an anthracycline such as daunorubicin. In certain embodiment, the patient is a de novo or secondary AML patient and a sample is used which is a bone marrow sample. In certain embodiments, the patient is a de novo AML patient and a sample is used which is a peripheral blood sample. The decision to treat the patient is made by the patient and/or one or more healthcare provider is based at least in part on the results of a test as described above, giving the probability for complete remission immediately after induction therapy, in which cells from a sample from the patient, e.g., a bone marrow sample or a peripheral blood sample, are treated with a combination of araC and daunorubicin for a time period, e.g., 24 hours, or any other suitable time period, then fixed, permeabilized, and exposed to an antibody cocktail containing labeled antibody to cPARP and labeled antibody to CD34, as well as antibody to CD45, and also exposed to Amine Aqua, and an additional cell sample at an early timepoint, e.g., 15 minutes or any suitable timepoint as described herein, where the early timepoint sample is also fixed, permeabilized, and exposed to the cocktail and to Amine Aqua, and the levels of cPARP, CD34, CD45, and Amine Aqua or other cell death indicator are detected by a suitable detector, e.g., a flow or mass cytometer, on a single cell basis, and the data is gated in an order of FSC vs SSC, then Amine Aqua vs SSC, then CD45 vs SSC. Then cPARP and CD34 are measured, and a decision to continue is based on a viability determination as described above. If the assay continues, the values for cPARP and CD34 at the later timepoint are compared to those at the earlier timepoint, using Uu metric. The classifier is obtained by multiplying each parameter ((Uu-0.5) in the case of cPARP and (0.5-Uu) in the case of CD34, one or both of which may be squared) by a coefficient, where the coefficient for cPARP is at least 1.5 greater than the coefficient for CD34, in some embodiments at least 2.0 times greater and in some embodiments at least 2.5 times greater, and further modified as described in Table 48, Example 22, to obtain a value between 0 and 1 that correlates to the probability that the patient will respond to induction treatment, with a value of 0 being 0 probability of response and a value of 1 being 100% probability of response. In certain embodiments, the patient is a de novo AML patient. In certain embodiments, the patient is a secondary AML patient. The decision to treat the patient may be made using other factors as well, such as patient age, gender, cytogenetics, health, especially cardiovascular health, and the like. 
     The invention also provides a system for treating an elderly patient (e.g., a patient greater than 55 years old, or as described elsewhere herein) suffering from AML with induction therapy, where the system includes the patient and one or more healthcare providers for the patient, a sample from the patient, such as a BM or PB sample, a transportation system for transporting the sample from the site of obtaining the sample to a test site, a test site for testing the sample to determine whether or not the patient will respond to induction therapy as described herein, a report-generating module for generating a report to communicate the results of the test to the patient and/or their healthcare provider(s), and a communication system for communicating the report to the patient and/or their healthcare provider so that a decision may be made to pursue induction therapy. The system may further include a site for administering induction therapy, for example, administering ara C to the patient and, generally, also administering an anthracycline such as daunorubicin to the patient. 
     In addition, kits are provided by the invention. The kits can provide at least two agents for inducing apoptosis in test cells, such as two agents selected from etoposide, ara C, daunorubicin, and staurosporine, for example, ara C and daunorubicin; a detectable binding element for detecting a marker of apoptosis where the marker is selected from pChk2, p-H2AX, Bcl-2, cytochrome c, c-caspase 3, c-caspase 8, and cPARP, for example, cPARP; at least two detectable binding elements for cell surface markers, such as at least two of CD34, CD11b, CD45, and CD117, for example, CD45 and CD34; and instructions for use, where the instructions for use may be physically included with the other elements of the kit or may be supplied separately for use with the kit by electronic or physical delivery to an end user of the kit. The detectable binding element can be an antibody or antibody fragment, as described elsewhere herein, for example, a labeled antibody such as a fluorescently labeled antibody or an antibody labeled with a mass tag. The kit can further include one or more reagents for detecting dead cells, such as Amine Aqua. The kit can further include at least one, or at least two control cell lines for maintaining consistency of the assay, such as one or more of the control cell lines described in Example 22. The kit can further include Rainbow Control Particles, such as those described in Example 22. The kit can further include cells that have been modulated then lyophilized, as controls to ensure that the assay is working for a particular modulator and activatable element. The kit can further include software, either in physical form, e.g., as tangible electronically readable medium, or delivered to the end user electronically, e.g., cloud-based. In addition, the kit may include buffers, equipment, apparatus, and the like as necessary or desirable to run the test in an optimal fashion. 
     Disease Conditions 
     The methods of the invention are applicable to any condition in an individual involving, indicated by, and/or arising from, in whole or in part, altered physiological status in a cell. The term “physiological status” includes mechanical, physical, and biochemical functions in a cell. In some embodiments, the physiological status of a cell is determined by measuring characteristics of cellular components of a cellular pathway. Cellular pathways are well known in the art. In some embodiments the cellular pathway is a signaling pathway. Signaling pathways are also well known in the art (see, e.g., Hunter T., Cell 100(1): 113-27 (2000); Cell Signaling Technology, Inc., 2002 Catalogue, Pathway Diagrams pgs. 232-253). A condition involving or characterized by altered physiological status may be readily identified, for example, by determining the state in a cell of one or more activatable elements, as taught herein. 
     In some embodiments, the present invention is directed to methods for classifying one or more cells in a sample derived from an individual having or suspected of having a condition. Example conditions include AML. In some embodiments, the invention allows for identification of prognostically and therapeutically relevant subgroups of the conditions and prediction of the clinical course of an individual. In some embodiments, the invention provides methods of classifying a cell according to the activation levels of one or more activatable elements in a cell from an individual having or suspected of having a condition. In some embodiments, the classification includes classifying the cell as a cell that is correlated with a clinical outcome. The clinical outcome can be the prognosis and/or diagnosis of a condition, and/or staging or grading of a condition. In some embodiments, the classifying of the cell includes classifying the cell as a cell that is correlated with a patient response to a treatment. In some embodiments, the classifying of the cell includes classifying the cell as a cell that is correlated with minimal residual disease or emerging resistance. 
     Activatable Elements 
     The methods and compositions of the invention may be employed to examine and profile the status of any activatable element in a cellular pathway, or collections of such activatable elements. Single or multiple distinct pathways may be profiled (e.g. sequentially or simultaneously), or subsets of activatable elements within a single pathway or across multiple pathways can be examined (e.g. sequentially or simultaneously). In some embodiments, apoptosis, signaling, cell cycle and/or DNA damage pathways are characterized in order to classify one or more cells in an individual. The characterization of multiple pathways can reveal operative pathways in a condition that can then be used to classify one or more cells in an individual. In some embodiments, the classification includes classifying the cell as a cell that is correlated with a clinical outcome. The clinical outcome can be the prognosis and/or diagnosis of a condition, and/or staging or grading of a condition. In some embodiments, the classifying of the cell includes classifying the cell as a cell that is correlated with a patient response to a treatment. In some embodiments, the classifying of the cell includes classifying the cell as a cell that is correlated with minimal residual disease or emerging resistance. In some embodiments, the cell classification includes correlating a response to a potential drug treatment. In another embodiment, the present invention includes a method for drug screening. See also U.S. Ser. Nos. 12/432,720 and 61/048,886 for activatable elements. 
     As will be appreciated by those in the art, a wide variety of activation events can find use in the methods described herein. In general, activation can result in a change in the activatable protein that is detectable by some indication (termed an “activation state indicator”), e.g. by altered binding of a labeled binding element or by changes in detectable biological activities (e.g., the activated state has an enzymatic activity which can be measured and compared to a lack of activity in the non-activated state). Using one or more detectable events or moieties, two or more activation states (e.g. “off” and “on”) can be differentiated. 
     The activation state of an individual activatable element can be in the on or off state. As an illustrative example, and without intending to be limited to any theory, an individual phosphorylatable site on a protein can activate or deactivate the protein. Phosphorylation of an adapter protein can promote its interaction with other components/proteins of distinct cellular signaling pathways. In another embodiment, the difference in enzymatic activity in a protein can reflect a different activation state. The terms “on” and “off,” when applied to an activatable element that is a part of a cellular constituent, are used here to describe the state of the activatable element, and not the overall state of the cellular constituent of which it is a part. 
     The activation state of an individual activatable element can be represented as continuous numeric values representing a quantity of the activatable element or can be discretized into categorical variables. For instance, the activation state may be discretized into a binary value indicating that the activatable element is either in the on or off state. As an illustrative example, and without intending to be limited to any theory, an individual phosphorylatable site on a protein will either be phosphorylated and then be in the “on” state or it will not be phosphorylated and hence, it will be in the “off” state. See Blume-Jensen and Hunter, Nature, vol 411, 17 May 2001, p 355-365. 
     Typically, a cell possesses a plurality of a particular protein or other constituent with a particular activatable element and this plurality of proteins or constituents usually has some proteins or constituents whose individual activatable element is in the on state and other proteins or constituents whose individual activatable element is in the off state. Since the activation state of each activatable element can be measured through the use of a binding element that recognizes a specific activation state, only those activatable elements in the specific activation state recognized by the binding element, representing some fraction of the total number of activatable elements, will be bound by the binding element to generate a measurable signal. The measurable signal corresponding to the summation of individual activatable elements of a particular type that are activated in a single cell can be the “activation level” for that activatable element in that cell. 
     Activation levels for a particular activatable element may vary among individual cells so that when a plurality of cells is analyzed, the activation levels follow a distribution. The distribution may be a normal distribution, also known as a Gaussian distribution, or it may be of another type. Different populations of cells may have different distributions of activation levels that can then serve to distinguish between the populations. For more information on the measurement of activatable elements, specific activatable elements, signaling pathways, and drug transporters, see U.S. Ser. No. 61/350,864 or U.S. Pub. No. 2009/0269773, which are hereby incorporated by reference in their entireties. 
     In some embodiments, the basis for classifying cells is that the distribution of activation levels for one or more specific activatable elements will differ among different phenotypes. A certain activation level, or more typically a range of activation levels for one or more activatable elements seen in a cell or a population of cells, is indicative that that cell or population of cells belongs to a distinctive phenotype. Other measurements, such as cellular levels (e.g., expression levels) of biomolecules that may not contain activatable elements, may also be used to classify cells in addition to activation levels of activatable elements; it will be appreciated that these levels also will follow a distribution, similar to activatable elements. Thus, the activation level or levels of one or more activatable elements, optionally in conjunction with levels of one or more levels of biomolecules that may or may not contain activatable elements, of cell or a population of cells may be used to classify a cell or a population of cells into a class. Once the activation level of intracellular activatable elements of individual single cells is known they can be placed into one or more classes, e.g., a class that corresponds to a phenotype. A class encompasses a class of cells wherein every cell has the same or substantially the same known activation level, or range of activation levels, of one or more intracellular activatable elements. For example, if the activation levels of five intracellular activatable elements are analyzed, predefined classes of cells that encompass one or more of the intracellular activatable elements can be constructed based on the activation level, or ranges of the activation levels, of each of these five elements. It is understood that activation levels can exist as a distribution and that an activation level of a particular element used to classify a cell may be a particular point on the distribution but more typically may be a portion of the distribution. 
     In some embodiments, the basis for classifying cells may use the position of a cell in a contour or density plot. The contour or density plot represents the number of cells that share a characteristic such as the activation level of activatable proteins in response to a modulator. For example, when referring to activation levels of activatable elements in response to one or more modulators, normal individuals and patients with a condition might show populations with increased activation levels in response to the one or more modulators. However, the number of cells that have a specific activation level (e.g. specific amount of an activatable element) might be different between normal individuals and patients with a condition. Thus, a cell can be classified according to its location within a given region in the contour or density plot. In other embodiments, the basis for classifying cells may use a series of population clusters whose centers, centroids, boundaries, relative positions describe the state of a cell, the diagnosis or prognosis of a patient, selection of treatment, or predicting response to treatment or to a combination of treatments, or long term outcome. 
     In some embodiments, the basis for classifying cells may use an N-dimensional Eigen map that describe the state of a cell, the diagnosis or prognosis of a patient, selection of treatment, or predicting response to treatment or to a combination of treatments, or long term outcome. 
     In other embodiments, the basis for classifying cells may use a Bayesian inference network of activatable elements interaction capabilities that together, or in part, describe the state of a cell, the diagnosis or prognosis of a patient, selection of treatment, or predicting response to treatment or to a combination of treatments, or long term outcome. See U.S. publication no. 2007/0009923 entitled Use of Bayesian Networks for Modeling Signaling Systems, incorporated herein by reference on its entirety. 
     In addition to activation levels of intracellular activatable elements, levels of intracellular or extracellular biomolecules, e.g., proteins, may be used alone or in combination with activation states of activatable elements to classify cells. Further, additional cellular elements, e.g., biomolecules or molecular complexes such as RNA, DNA, carbohydrates, metabolites, and the like, may be used in conjunction with activatable states or expression levels in the classification of cells encompassed here. 
     In some embodiments, cellular redox signaling nodes are analyzed for a change in activation level. Reactive oxygen species (ROS) are involved in a variety of different cellular processes ranging from apoptosis and necrosis to cell proliferation and carcinogenesis. ROS can modify many intracellular signaling pathways including protein phosphatases, protein kinases, and transcription factors. This activity may indicate that the majority of the effects of ROS are through their actions on signaling pathways rather than via non-specific damage of macromolecules. The exact mechanisms by which redox status induces cells to proliferate or to die, and how oxidative stress can lead to processes evoking tumor formation are still under investigation. See Mates, J M et al., Arch Toxicol. 2008 May: 82(5):271-2; Galaris D., et al., Cancer Lett. 2008 Jul. 18; 266(1)21-9. 
     Reactive oxygen species can be measured. One example technique is by flow cytometry. See Chang et al., Lymphocyte proliferation modulated by glutamine: involved in the endogenous redox reaction; Clin Exp Immunol. 1999 September; 117(3): 482-488. Redox potential can be evaluated by means of an ROS indicator, one example being 2′,7′-dichlorofluorescein-diacetate (DCFH-DA) which is added to the cells at an exemplary time and temperature, such as 37° C. for 15 minutes. DCF peroxidation can be measured using flow cytometry. See Yang K D, Shaio M F. Hydroxyl radicals as an early signal involved in phorbol ester-induced monocyte differentiation of HL60 cells. Biochem Biophys Res Commun. 1994; 200:1650-7 and Wang J F, Jerrells T R, Spitzer J J. Decreased production of reactive oxygen intermediates is an early event during in vitro apoptosis of rat thymocytes. Free Radic Biol Med. 1996; 20:533-42. 
     In some embodiments, other characteristics that affect the status of a cellular constituent may also be used to classify a cell. Examples include the translocation of biomolecules or changes in their turnover rates and the formation and disassociation of complexes of biomolecule. Such complexes can include multi-protein complexes, multi-lipid complexes, homo- or hetero-dimers or oligomers, and combinations thereof. Other characteristics include proteolytic cleavage, e.g. from exposure of a cell to an extracellular protease or from the intracellular proteolytic cleavage of a biomolecule. 
     In some embodiments, cellular pH is analyzed. See June, C H and Moore, and J S, Curr Protoc Immulon, 2004 December; Chapter 5:Unit 5.5; Leyval, D et al., Flow cytometry for the intracellular pH measurement of glutamate producing  Corynebacterium glutamicum , Journal of Microbiological Methods, Volume 29, Issue 2, 1 May 1997, Pages 121-127; Weider, E D, et al., Measurement of intracellular pH using flow cytometry with carboxy-SNARF-1. Cytometry, 1993 November; 14(8):916-21; and Valli, M, et al., Intracellular pH Distribution in  Saccharomyces cerevisiae  Cell Populations, Analyzed by Flow Cytometry, Applied and Environmental Microbiology, March 2005, p. 1515-1521, Vol. 71, No. 3. 
     In some embodiments, the activatable element is the phosphorylation of immunoreceptor tyrosine-based inhibitory motif (ITIM). An immunoreceptor tyrosine-based inhibition motif (ITIM), is a conserved sequence of amino acids (S/I/V/LxYxxI/V/L) that is found in the cytoplasmic tails of many inhibitory receptors of the immune system. After ITIM-possessing inhibitory receptors interact with their ligand, their ITIM motif becomes phosphorylated by enzymes of the Src family of kinases, allowing them to recruit other enzymes such as the phosphotyrosine phosphatases SHP-1 and SHP-2, or the inositol-phosphatase called SHIP. These phosphatases decrease the activation of molecules involved in cell signaling. See Barrow A, Trowsdale J (2006). “You say ITAM and I say ITIM, let&#39;s call the whole thing off: the ambiguity of immunoreceptor signalling”. Eur J Immunol 36 (7): 1646-53. When phosphorylated, these phospho-tyrosine residues provide docking sites for the Shps which may result in transmission of inhibitory signals and effect the signaling of neighboring membrane receptor complexes (Paul et al., Blood (2000 96:483). ITIMs can be analyzed by flow cytometry. 
     Additional elements may also be used to classify a cell, such as the expression level of extracellular or intracellular markers, nuclear antigens, enzymatic activity, protein expression and localization, cell cycle analysis, chromosomal analysis, cell volume, and morphological characteristics like granularity and size of nucleus or other distinguishing characteristics. For example, B cells can be further subdivided based on the expression of cell surface markers such as CD19, CD20, CD22 or CD23. 
     Alternatively, predefined classes of cells can be aggregated or grouped based upon shared characteristics that may include inclusion in one or more additional predefined class or the presence of extracellular or intracellular markers, similar gene expression profile, nuclear antigens, enzymatic activity, protein expression and localization, cell cycle analysis, chromosomal analysis, cell volume, and morphological characteristics like granularity and size of nucleus or other distinguishing cellular characteristics. 
     In some embodiments, the physiological status of one or more cells is determined by examining and profiling the activation level of one or more activatable elements in a cellular pathway. In some embodiments, a cell is classified according to the activation level of a plurality of activatable elements. In some embodiments, a hematopoietic cell is classified according to the activation levels of a plurality of activatable elements. In some embodiments, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 or more activatable elements may be analyzed in a cell signaling pathway. In some embodiments, the activation levels of one or more activatable elements of a hematopoietic cell are correlated with a condition. In some embodiments, the activation levels of one or more activatable elements of a hematopoietic cell are correlated with a neoplastic or hematopoietic condition as described herein. Examples of hematopoietic cells include, but are not limited to, AML cells. 
     In some embodiments, the activation level of one or more activatable elements in single cells in the sample is determined. Cellular constituents that may include activatable elements include without limitation proteins, carbohydrates, lipids, nucleic acids and metabolites. The activatable element may be a portion of the cellular constituent, for example, an amino acid residue in a protein that may undergo phosphorylation, or it may be the cellular constituent itself, for example, a protein that is activated by translocation, change in conformation (due to, e.g., change in pH or ion concentration), by proteolytic cleavage, degradation through ubiquitination and the like. Upon activation, a change occurs to the activatable element, such as covalent modification of the activatable element (e.g., binding of a molecule or group to the activatable element, such as phosphorylation) or a conformational change. Such changes generally contribute to changes in particular biological, biochemical, or physical properties of the cellular constituent that contains the activatable element. The state of the cellular constituent that contains the activatable element is determined to some degree, though not necessarily completely, by the state of a particular activatable element of the cellular constituent. For example, a protein may have multiple activatable elements, and the particular activation states of these elements may overall determine the activation state of the protein; the state of a single activatable element is not necessarily determinative. Additional factors, such as the binding of other proteins, pH, ion concentration, interaction with other cellular constituents, and the like, can also affect the state of the cellular constituent. 
     In some embodiments, the activation levels of a plurality of intracellular activatable elements in single cells are determined. In some embodiments, at least about 2, 3, 4, 5, 6, 7, 8, 9, 10 or more than 10 intracellular activatable elements are determined. 
     Activation states of activatable elements may result from chemical additions or modifications of biomolecules and include biochemical processes such as glycosylation, phosphorylation, acetylation, methylation, biotinylation, glutamylation, glycylation, hydroxylation, isomerization, prenylation, myristoylation, lipoylation, phosphopantetheinylation, sulfation, ISGylation, nitrosylation, palmitoylation, SUMOylation, ubiquitination, neddylation, citrullination, amidation, and disulfide bond formation, disulfide bond reduction. Other possible chemical additions or modifications ofbiomolecules include the formation of protein carbonyls, direct modifications of protein side chains, such as o-tyrosine, chloro-, nitrotyrosine, and dityrosine, and protein adducts derived from reactions with carbohydrate and lipid derivatives. Other modifications may be non-covalent, such as binding of a ligand or binding of an allosteric modulator. 
     One example of a covalent modification is the substitution of a phosphate group for a hydroxyl group in the side chain of an amino acid (phosphorylation). A wide variety of proteins are known that recognize specific protein substrates and catalyze the phosphorylation of serine, threonine, or tyrosine residues on their protein substrates. Such proteins are generally termed “kinases.” Substrate proteins that are capable of being phosphorylated are often referred to as phosphoproteins (after phosphorylation). Once phosphorylated, a substrate phosphoprotein may have its phosphorylated residue converted back to a hydroxyl one by the action of a protein phosphatase that specifically recognizes the substrate protein. Protein phosphatases catalyze the replacement of phosphate groups by hydroxyl groups on serine, threonine, or tyrosine residues. Through the action of kinases and phosphatases a protein may be reversibly phosphorylated on a multiplicity of residues and its activity may be regulated thereby. Thus, the presence or absence of one or more phosphate groups in an activatable protein is a preferred readout in the present invention. 
     Another example of a covalent modification of an activatable protein is the acetylation of histones. Through the activity of various acetylases and deacetlylases the DNA binding function of histone proteins is tightly regulated. Furthermore, histone acetylation and histone deactelyation have been linked with malignant progression. See Nature, 2004 May 27; 429(6990): 457-63. 
     Another form of activation involves cleavage of the activatable element. For example, one form of protein regulation involves proteolytic cleavage of a peptide bond. While random or misdirected proteolytic cleavage may be detrimental to the activity of a protein, many proteins are activated by the action of proteases that recognize and cleave specific peptide bonds. Many proteins derive from precursor proteins, or pro-proteins, which give rise to a mature isoform of the protein following proteolytic cleavage of specific peptide bonds. Many growth factors are synthesized and processed in this manner, with a mature isoform of the protein typically possessing a biological activity not exhibited by the precursor form. Many enzymes are also synthesized and processed in this manner, with a mature isoform of the protein typically being enzymatically active, and the precursor form of the protein being enzymatically inactive. This type of regulation is generally not reversible. Accordingly, to inhibit the activity of a proteolytically activated protein, mechanisms other than “reattachment” must be used. For example, many proteolytically activated proteins are relatively short-lived proteins, and their turnover effectively results in deactivation of the signal. Inhibitors may also be used. Among the enzymes that are proteolytically activated are serine and cysteine proteases, including cathepsins and caspases respectively. 
     In one embodiment, the activatable enzyme is a caspase. The caspases are an important class of proteases that mediate programmed cell death (referred to in the art as “apoptosis”). Caspases are constitutively present in most cells, residing in the cytosol as a single chain proenzyme. These are activated to fully functional proteases by a first proteolytic cleavage to divide the chain into large and small caspase subunits and a second cleavage to remove the N-terminal domain. The subunits assemble into a tetramer with two active sites (Green, Cell 94:695-698, 1998). Many other proteolytically activated enzymes, known in the art as “zymogens,” also find use in the instant invention as activatable elements. 
     In an alternative embodiment the activation of the activatable element involves prenylation of the element. By “prenylation”, and grammatical equivalents used herein, is meant the addition of any lipid group to the element. Common examples of prenylation include the addition of farnesyl groups, geranylgeranyl groups, myristoylation and palmitoylation. In general these groups are attached via thioether linkages to the activatable element, although other attachments may be used. 
     In alternative embodiment, activation of the activatable element is detected as intermolecular clustering of the activatable element. By “clustering” or “multimerization”, and grammatical equivalents used herein, is meant any reversible or irreversible association of one or more signal transduction elements. Clusters can be made up of 2, 3, 4, etc., elements. Clusters of two elements are termed dimers. Clusters of 3 or more elements are generally termed oligomers, with individual numbers of clusters having their own designation; for example, a cluster of 3 elements is a trimer, a cluster of 4 elements is a tetramer, etc. 
     Clusters can be made up of identical elements or different elements. Clusters of identical elements are termed “homo” dimers, while clusters of different elements are termed “hetero” clusters. Accordingly, a cluster can be a homodimer, as is the case for the β 2 -adrenergic receptor. 
     Alternatively, a cluster can be a heterodimer, as is the case for GABA B-R . In other embodiments, the cluster is a homotrimer, as in the case of TNFα, or a heterotrimer such the one formed by membrane-bound and soluble CD95 to modulate apoptosis. In further embodiments the cluster is a homo-oligomer, as in the case of Thyrotropin releasing hormone receptor, or a hetero-oligomer, as in the case of TGFβ1. 
     In a preferred embodiment, the activation or signaling potential of elements is mediated by clustering, irrespective of the actual mechanism by which the element&#39;s clustering is induced. For example, elements can be activated to cluster a) as membrane bound receptors by binding to ligands (ligands including both naturally occurring and synthetic ligands), b) as membrane bound receptors by binding to other surface molecules, or c) as intracellular (non-membrane bound) receptors binding to ligands. 
     In some embodiments, the activatable element is a protein. Examples of proteins that may include activatable elements include, but are not limited to kinases, phosphatases, lipid signaling molecules, adaptor/scaffold proteins, cytokines, cytokine regulators, ubiquitination enzymes, adhesion molecules, cytoskeletal/contractile proteins, heterotrimeric G proteins, small molecular weight GTPases, guanine nucleotide exchange factors, GTPase activating proteins, caspases, proteins involved in apoptosis, cell cycle regulators, molecular chaperones, metabolic enzymes, vesicular transport proteins, hydroxylases, isomerases, deacetylases, methylases, demethylases, tumor suppressor genes, proteases, ion channels, molecular transporters, transcription factors/DNA binding factors, regulators of transcription, and regulators of translation. Examples of activatable elements, activation states and methods of determining the activation level of activatable elements are described in U.S. Publication Number 20060073474 entitled “Methods and compositions for detecting the activation state of multiple proteins in single cells” and U.S. Publication Number 20050112700 entitled “Methods and compositions for risk stratification” the content of which are incorporate here by reference. See also U.S. Ser. Nos. 12/432,720 and 12/229,476; and Shulz et al., Current Protocols in Immunology 2007, 7:8.17.1-20. 
     In some embodiments, the protein that may be activated is selected from the group consisting of HER receptors, PDGF receptors, FLT3 receptor, Kit receptor, FGF receptors, Eph receptors, Trk receptors, IGF receptors, Insulin receptor, Met receptor, Ret, VEGF receptors, erythropoetin receptor, thromobopoetin receptor, CD114, CD116, TIE1, TIE2, FAK, Jak1, Jak2, Jak3, Tyk2, Src, Lyn, Fyn, Lck, Fgr, Yes, Csk, Abl, Btk, ZAP70, Syk, IRAKs, cRaf, ARaf, BRAF, Mos, Lim kinase, ILK, Tpl, ALK, TGF (3 receptors, BMP receptors, MEKKs, ASK, MLKs, DLK, PAKs, Mek 1, Mek 2, MKK3/6, MKK4/7, ASK1, Cot, NIK, Bub, Myt 1, Weel, Casein kinases, PDK1, SGK1, SGK2, SGK3, Akt1, Akt2, Akt3, p90Rsks, p70S6Kinase, Prks, PKCs, PKAs, ROCK 1, ROCK 2, Auroras, CaMKs, MNKs, AMPKs, MELK, MARKs, Chk1, Chk2, LKB-1, MAPKAPKs, Pim1, Pim2, Pim3, IKKs, Cdks, Jnks, Erks, IKKs, GSK3α, GSK 3β, Cdks, CLKs, PKR, PI3-Kinase class 1, class 2, class 3, mTor, SAPK/JNK1,2,3, p38s, PKR, DNA-PK, ATM, ATR, Receptor protein tyrosine phosphatases (RPTPs), LAR phosphatase, CD45, Non receptor tyrosine phosphatases (NPRTPs), SHPs, MAP kinase phosphatases (MKPs), Dual Specificity phosphatases (DUSPs), CDC25 phosphatases, Low molecular weight tyrosine phosphatase, Eyes absent (EYA) tyrosine phosphatases, Slingshot phosphatases (SSH), serine phosphatases, PP2A, PP2B, PP2C, PP1, PP5, inositol phosphatases, PTEN, SHIPs, myotubularins, phosphoinositide kinases, phopsholipases, prostaglandin synthases, 5-lipoxygenase, sphingosine kinases, sphingomyelinases, adaptor/scaffold proteins, Shc, Grb2, BLNK, LAT, B cell adaptor for PI3-kinase (BCAP), SLAP, Dok, KSR, MyD88, Crk, CrkL, GAD, Nck, Grb2 associated binder (GAB), Fas associated death domain (FADD), TRADD, TRAF2, RIP, T-Cell leukemia family, IL-2, IL-4, IL-8, IL-6, interferon gamma, interferon α, suppressors of cytokine signaling (SOCs), Cbl, SCF ubiquitination ligase complex, APC/C, adhesion molecules, integrins, Immunoglobulin-like adhesion molecules, selectins, cadherins, catenins, focal adhesion kinase, p130CAS, fodrin, actin, paxillin, myosin, myosin binding proteins, tubulin, eg5/KSP, CENPs, 3-adrenergic receptors, muscarinic receptors, adenylyl cyclase receptors, small molecular weight GTPases, H-Ras, K-Ras, N-Ras, Ran, Rac, Rho, Cdc42, Arfs, RABs, RHEB, Vav, Tiam, Sos, Dbl, PRK, TSC1,2, Ras-GAP, Arf-GAPs, Rho-GAPs, caspases, Caspase 2, Caspase 3, Caspase 6, Caspase 7, Caspase 8, Caspase 9, Bcl-2, Mcl-1, Bcl-XL, Bcl-w, Bcl-B, Al, Bax, Bak, Bok, Bik, Bad, Bid, Bim, Bmf, Hrk, Noxa, Puma, IAPs, XIAP, Smac, Cdk4, Cdk 6, Cdk 2, Cdk1, Cdk 7, Cyclin D, Cyclin E, Cyclin A, Cyclin B, Rb, p16, p14Arf, p27KIP, p21CIP, molecular chaperones, Hsp90s, Hsp70, Hsp27, metabolic enzymes, Acetyl-CoAa Carboxylase, ATP citrate lyase, nitric oxide synthase, caveolins, endosomal sorting complex required for transport (ESCRT) proteins, vesicular protein sorting (Vsps), hydroxylases, prolyl-hydroxylases PHD-1, 2 and 3, asparagine hydroxylase FIH transferases, Pin1 prolyl isomerase, topoisomerases, deacetylases, Histone deacetylases, sirtuins, histone acetylases, CBP/P300 family, MYST family, ATF2, DNA methyl transferases, Histone H3K4 demethylases, H3K27, JHDM2A, UTX, VHL, WT-1, p53, Hdm, PTEN, ubiquitin proteases, urokinase-type plasminogen activator (uPA) and uPA receptor (uPAR) system, cathepsins, metalloproteinases, esterases, hydrolases, separase, potassium channels, sodium channels, multi-drug resistance proteins, P-Gycoprotein, nucleoside transporters, Ets, Elk, SMADs, Rel-A (p65-NFKB), CREB, NFAT, ATF-2, AFT, Myc, Fos, Spl, Egr-1, T-bet, β-catenin, HIFs, FOXOs, E2Fs, SRFs, TCFs, Egr-1, β-(tilde over the beta) catenin, FOXO STAT1, STAT 3, STAT 4, STAT 5, STAT 6, p53, WT-1, HMGA, pS6, 4EPB-1, eIF4E-binding protein, RNA polymerase, initiation factors, and elongation factors. 
     In another embodiment the activatable element is a nucleic acid. Activation and deactivation of nucleic acids can occur in numerous ways including, but not limited to, cleavage of an inactivating leader sequence as well as covalent or non-covalent modifications that induce structural or functional changes. For example, many catalytic RNAs, e.g. hammerhead ribozymes, can be designed to have an inactivating leader sequence that deactivates the catalytic activity of the ribozyme until cleavage occurs. An example of a covalent modification is methylation of DNA. Deactivation by methylation has been shown to be a factor in the silencing of certain genes, e.g. STAT regulating SOCS genes in lymphomas. See Leukemia. See February 2004; 18(2): 356-8. SOCS1 and SHP1 hypermethylation in mantle cell lymphoma and follicular lymphoma: implications for epigenetic activation of the Jak/STAT pathway. Chim C S, Wong K Y, Loong F, Srivastava G. 
     In another embodiment the activatable element is a small molecule, carbohydrate, lipid or other naturally occurring or synthetic compound capable of having an activated isoform. In addition, as pointed out above, activation of these elements need not include switching from one form to another, but can be detected as the presence or absence of the compound. For example, activation of cAMP (cyclic adenosine mono-phosphate) can be detected as the presence of cAMP rather than the conversion from non-cyclic AMP to cyclic AMP. 
     In some embodiments of the invention, the methods described herein are employed to determine the activation level of an activatable element, e.g., in a cellular pathway. Methods and compositions are provided for the classification of a cell according to the activation level of an activatable element in a cellular pathway. The cell can be a hematopoietic cell. Examples of hematopoietic cells include but are not limited to pluripotent hematopoietic stem cells, granulocyte lineage progenitor or derived cells, monocyte lineage progenitor or derived cells, macrophage lineage progenitor or derived cells, megakaryocyte lineage progenitor or derived cells and erythroid lineage progenitor or derived cells. 
     In some embodiments, the cell is classified according to the activation level of an activatable element, e.g., in a cellular pathway comprises classifying the cell as a cell that is correlated with a clinical outcome. In some embodiments, the clinical outcome is the prognosis and/or diagnosis of a condition. In some embodiments, the clinical outcome is the presence or absence of a neoplastic or a hematopoietic condition. In some embodiments, the clinical outcome is the staging or grading of a neoplastic or hematopoietic condition. Examples of staging include, but are not limited to, aggressive, indolent, benign, refractory, Roman Numeral staging, TNM Staging, Rai staging, Binet staging, WHO classification, FAB classification, IPSS score, WPSS score, limited stage, extensive stage, staging according to cellular markers such as ZAP70 and CD38, occult, including information that may inform on time to progression, progression free survival, overall survival, or event-free survival. 
     In some embodiments, methods and compositions are provided for the classification of a cell according to the activation level of an activatable element, e.g., in a cellular pathway wherein the classification comprises classifying a cell as a cell that is correlated to a patient response to a treatment. In some embodiments, the patient response is selected from the group consisting of complete response, partial response, nodular partial response, no response, progressive disease, stable disease and adverse reaction. 
     In some embodiments, methods and compositions are provided for the classification of a cell according to the activation level of an activatable element, e.g., in a cellular pathway wherein the classification comprises classifying the cell as a cell that is correlated with minimal residual disease or emerging resistance. 
     In some embodiments, methods and compositions are provided for the classification of a cell according to the activation level of an activatable element, e.g., in a cellular pathway wherein the classification comprises selecting a method of treatment. Example of methods of treatments include, but are not limited to, chemotherapy, biological therapy, radiation therapy, bone marrow transplantation, Peripheral stem cell transplantation, umbilical cord blood transplantation, autologous stem cell transplantation, allogeneic stem cell transplantation, syngeneic stem cell transplantation, surgery, induction therapy, maintenance therapy, and watchful waiting. 
     Generally, the methods of the invention involve determining the activation levels of an activatable element in a plurality of single cells in a sample. 
     Signaling Pathways 
     In some embodiments, the methods of the invention are employed to determine the status of an activatable element in a signaling pathway. In some embodiments, a cell is classified, as described herein, according to the activation level of one or more activatable elements in one or more signaling pathways. Signaling pathways and their members have been described. See (Hunter T. Cell Jan. 7, 2000; 100(1): 13-27; Weinberg, 2007; and Blume-Jensen and Hunter, Nature, vol 411, 17 May 2001, p 355-365 cited above). Exemplary signaling pathways include the following pathways and their members: the JAK-STAT pathway including JAKs, STATs 2, 3 4 and 5, the FLT3L signaling pathway, the MAP kinase pathway including Ras, Raf, MEK, ERK and Elk; the PI3K/Akt pathway including PI-3-kinase, PDK1, Akt and Bad; the NF-κB pathway including IKKs, IkB and NF-κB, and the Wnt pathway including frizzled receptors, beta-catenin, APC and other co-factors and TCF (see Cell Signaling Technology, Inc. 2002 Catalog pages 231-279 and Hunter T., supra.). In some embodiments, the correlated activatable elements being assayed (or the signaling proteins being examined) are members of the MAP kinase, Akt, NFkB, WNT, STAT and/or PKC signaling pathways. See the description of signaling pathways in U.S. Ser. No. 12/910,769 which is incorporated by reference in its entirety. 
     In some embodiments, the status of an activatable element within the PI3K/AKT, or MAPK pathways in response to a growth factor or mitogen is determined. In some embodiments, the activatable element within the PI3K/AKT or MAPK pathway is selected from the group consisting of Akt, p-Erk, p38 and pS6 and the growth factor or mitogen is selected from the group consisting of FLT3L, SCF, G-CSF, SCF, G-CSF, SDF1a, LPS, PMA and Thapsigargin. 
     In some embodiments, the status of an activatable element within JAK/STAT pathways in response to a cytokine is determined. In some embodiments, the activatable element within the JAK/STAT pathway is selected from the group consisting of p-Stat3, p-Stat5, p-Stat1, and p-Stat6 and the cytokine is selected from the group consisting of IFNg, IFNa, IL-27, IL-3, IL-6, IL-10, and G-CSF. In some embodiments, the activatable element within the STAT pathway is Stat 1 and the cytokine is IL-27 or G-CSF. 
     In some embodiments, the status of an activatable element within the phospholipase C pathway in response to an inhibitor is determined. In some embodiments, the activatable element within the phospholipase C pathway is selected from the group consisting of p-Slp-76, and Plcg2 and the inhibitor is H 2 O 2 . 
     In some embodiments, the status of a phosphatase in response to an inhibitor is determined. In some embodiments, the inhibitor is H 2 O 2 . 
     In some embodiments, the methods of the invention are employed to determine the status of a signaling protein in a signaling pathway known in the art including those described herein. Exemplary types of signaling proteins within the scope of the present invention include, but are not limited to kinases, kinase substrates (i.e. phosphorylated substrates), phosphatases, phosphatase substrates, binding proteins (such as 14-3-3), receptor ligands and receptors (cell surface receptor tyrosine kinases and nuclear receptors)). Kinases and protein binding domains, for example, have been well described (see, e.g., Cell Signaling Technology, Inc., 2002 Catalogue “The Human Protein Kinases” and “Protein Interaction Domains” pgs. 254-279). 
     Nuclear Factor-kappaB (NF-κB) Pathway: 
     Nuclear factor-kappaB (NF-kappaB) transcription factors and the signaling pathways that activate them are central coordinators of innate and adaptive immune responses. More recently, it has become clear that NF-kappaB signaling also has a critical role in cancer development and progression. NF-kappaB provides a mechanistic link between inflammation and cancer, and is a major factor controlling the ability of both pre-neoplastic and malignant cells to resist apoptosis-based tumor-surveillance mechanisms. In mammalian cells, there are five NF-κB family members, RelA (p65), RelB, c-Rel, p50/p105 (NF-κB1) and p52/p100 (NF-κB2) and different NF-κB complexes are formed from their homo and heterodimers. In most cell types, NF-κB complexes are retained in the cytoplasm by a family of inhibitory proteins known as inhibitors of NF-κB (IκBs). Activation of NF-κB typically involves the phosphorylation of IκB by the IκB kinase (IKK) complex, which results in IκB ubiquitination with subsequent degradation. This releases NF-κB and allows it to translocate freely to the nucleus. The genes regulated by NF-κB include those controlling programmed cell death, cell adhesion, proliferation, the innate- and adaptive-immune responses, inflammation, the cellular-stress response and tissue remodeling. However, the expression of these genes is tightly coordinated with the activity of many other signaling and transcription-factor pathways. Therefore, the outcome of NF-κB activation depends on the nature and the cellular context of its induction. For example, it has become apparent that NF-κB activity can be regulated by both oncogenes and tumor suppressors, resulting in either stimulation or inhibition of apoptosis and proliferation. See Perkins, N.  Integrating cell - signaling pathways with NF - κB and IKK function . Reviews: Molecular Cell Biology. January, 2007; 8(1): 49-62, hereby fully incorporated by reference in its entirety for all purposes. Hayden, M.  Signaling to NF - κB . Genes &amp; Development. 2004; 18: 2195-2224, hereby fully incorporated by reference in its entirety for all purposes. Perkins, N.  Good Cop, Bad Cop: The Different Faces of NF - κB . Cell Death and Differentiation. 2006; 13: 759-772, hereby fully incorporated by reference in its entirety for all purposes. 
     Phosphatidylinositol 3-kinase (PI3-K)/AKT Pathway: 
     PI3-Ks are activated by a wide range of cell surface receptors to generate the lipid second messengers phosphatidylinositol 3,4-biphosphate (PIP 2 ) and phosphatidylinositol 3,4,5-trisphosphate (PIP 3 ). Examples of receptor tyrosine kinases include but are not limited to FLT3 LIGAND, EGFR, IGF-1R, HER2/neu, VEGFR, and PDGFR. The lipid second messengers generated by PI3Ks regulate a diverse array of cellular functions. The specific binding of PI3,4P 2  and PI3,4,5P 3  to target proteins is mediated through the pleckstrin homology (PH) domain present in these target proteins. One key downstream effector of PI3-K is Akt, a serine/threonine kinase, which is activated when its PH domain interacts with PI3, 4P 2  and PI3,4,5P 3  resulting in recruitment of Akt to the plasma membrane. Once there, in order to be fully activated, Akt is phosphorylated at threonine 308 by 3-phosphoinositide-dependent protein kinase-1 (PDK-1) and at serine 473 by several PDK2 kinases. Akt then acts downstream of PI3K to regulate the phosphorylation of a number of substrates, including but not limited to forkhead box O transcription factors, Bad, GSK-3β, I-κB, mTOR, MDM-2, and S6 ribosomal subunit. These phosphorylation events in turn mediate cell survival, cell proliferation, membrane trafficking, glucose homeostasis, metabolism and cell motility. Deregulation of the PI3K pathway occurs by activating mutations in growth factor receptors, activating mutations in a PI3-K gene (e.g. PIK3CA), loss of function mutations in a lipid phosphatase (e.g. PTEN), up-regulation of Akt, or the impairment of the tuberous sclerosis complex (TSC1/2). All these events are linked to increased survival and proliferation. See Vivanco, I.  The Phosphatidylinositol  3- Kinase - AKT Pathway in Human Cancer . Nature Reviews: Cancer. July, 2002; 2: 489-501 and Shaw, R.  Ras, PI (3) K and mTOR signaling controls tumor cell growth . Nature. May, 2006; 441: 424-430, Marone et al., Biochimica et Biophysica Acta, 2008; 1784, p 159-185 hereby fully incorporated by reference in their entirety for all purposes. 
     Wnt Pathway: 
     The Wnt signaling pathway describes a complex network of proteins well known for their roles in embryogenesis, normal physiological processes in adult animals, such as tissue homeostasis, and cancer. Further, a role for the Wnt pathway has been shown in self-renewal of hematopoietic stem cells (Reya T et al., Nature. 2003 May 22; 423(6938):409-14). Cytoplasmic levels of β-catenin are normally kept low through the continuous proteosomal degradation of β-catenin controlled by a complex of glycogen synthase kinase 33 (GSK-3 β), axin, and adenomatous polyposis coli (APC). When Wnt proteins bind to a receptor complex composed of the Frizzled receptors (Fz) and low density lipoprotein receptor-related protein (LRP) at the cell surface, the GSK-3/axin/APC complex is inhibited. Key intermediates in this process include disheveled (Dsh) and axin binding the cytoplasmic tail of LRP. Upon Wnt signaling and inhibition of the β-catenin degradation pathway, β-catenin accumulates in the cytoplasm and nucleus. Nuclear β-catenin interacts with transcription factors such as lymphoid enhanced-binding factor 1 (LEF) and T cell-specific transcription factor (TCF) to affect transcription of target genes. See Gordon, M.  Wnt Signaling: Multiple Pathways, Multiple Receptors, and Multiple Transcription Factors . J of Biological Chemistry. June, 2006; 281(32): 22429-22433, Logan C Y, Nusse R: The Wnt signaling pathway in development and disease. Annu Rev Cell Dev Biol 2004, 20:781-810, Clevers H: Wnt/beta-catenin signaling in development and disease. Cell 2006, 127:469-480. Hereby fully incorporated by reference in its entirety for all purposes. 
     Protein Kinase C (PKC) Signaling: 
     The PKC family of serine/threonine kinases mediates signaling pathways following activation of receptor tyrosine kinases, G-protein coupled receptors and cytoplasmic tyrosine kinases. Activation of PKC family members is associated with cell proliferation, differentiation, survival, immune function, invasion, migration and angiogenesis. Disruption of PKC signaling has been implicated in tumorigenesis and drug resistance. PKC isoforms have distinct and overlapping roles in cellular functions. PKC was originally identified as a phospholipid and calcium-dependent protein kinase. The mammalian PKC superfamily consists of 13 different isoforms that are divided into four subgroups on the basis of their structural differences and related cofactor requirements cPKC (classical PKC) isoforms (α, βI, βII and γ), which respond both to Ca2+ and DAG (diacylglycerol), nPKC (novel PKC) isoforms (δ, ε, θ and η), which are insensitive to Ca2+, but dependent on DAG, atypical PKCs (aPKCs, ι/λ, ζ), which are responsive to neither co-factor, but may be activated by other lipids and through protein-protein interactions, and the related PKN (protein kinase N) family (e.g. PKN1, PKN2 and PKN3), members of which are subject to regulation by small GTPases. Consistent with their different biological functions, PKC isoforms differ in their structure, tissue distribution, subcellular localization, mode of activation and substrate specificity. Before maximal activation of its kinase, PKC requires a priming phosphorylation which is provided constitutively by phosphoinositide-dependent kinase 1 (PDK-1). The phospholipid DAG has a central role in the activation of PKC by causing an increase in the affinity of classical PKCs for cell membranes accompanied by PKC activation and the release of an inhibitory substrate (a pseudo-substrate) to which the inactive enzyme binds. Activated PKC then phosphorylates and activates a range of kinases. The downstream events following PKC activation are poorly understood, although the MEK-ERK (mitogen activated protein kinase kinase-extracellular signal-regulated kinase) pathway is thought to have an important role. There is also evidence to support the involvement of PKC in the PI3K-Akt pathway. PKC isoforms probably form part of the multi-protein complexes that facilitate cellular signal transduction. Many reports describe dysregulation of several family members. For example alterations in PKCε have been detected in thyroid cancer, and have been correlated with aggressive, metastatic breast cancer and PKCι was shown to be associated with poor outcome in ovarian cancer. (Knauf J A, et al. Isozyme-Specific Abnormalities of PKC in Thyroid Cancer: Evidence for Post-Transcriptional Changes in PKC Epsilon.  The Journal of Clinical Endocrinology  &amp;  Metabolism . Vol. 87, No. 5, pp 2150-2159; Zhang L et al.  Integrative Genomic Analysis of Protein Kinase C  ( PKC )  Family Identifies PKC{iota} as a Biomarker and Potential Oncogene in Ovarian Carcinoma . Cancer Res. 2006, Vol 66, No. 9, pp 4627-4635) 
     Mitogen Activated Protein (MAP) Kinase Pathways: 
     MAP kinases transduce signals that are involved in a multitude of cellular pathways and functions in response to a variety of ligands and cell stimuli. (Lawrence et al., Cell Research (2008) 18: 436-442). Signaling by MAPKs affects specific events such as the activity or localization of individual proteins, transcription of genes, and increased cell cycle entry, and promotes changes that orchestrate complex processes such as embryogenesis and differentiation. Aberrant or inappropriate functions of MAPKs have now been identified in diseases ranging from cancer to inflammatory disease to obesity and diabetes. MAPKs are activated by protein kinase cascades consisting of three or more protein kinases in series: MAPK kinase kinases (MAP3Ks) activate MAPK kinases (MAP2Ks) by dual phosphorylation on S/T residues; MAP2Ks then activate MAPKs by dual phosphorylation on Y and T residues MAPKs then phosphorylate target substrates on select S/T residues typically followed by a proline residue. In the ERK1/2 cascade the MAP3K is usually a member of the Raf family. Many diverse MAP3Ks reside upstream of the p38 and the c-Jun N-terminal kinase/stress-activated protein kinase (JNK/SAPK) MAPK groups, which have generally been associated with responses to cellular stress. Downstream of the activating stimuli, the kinase cascades may themselves be stimulated by combinations of small G proteins, MAP4Ks, scaffolds, or oligomerization of the MAP3K in a pathway. In the ERK1/2 pathway, Ras family members usually bind to Raf proteins leading to their activation as well as to the subsequent activation of other downstream members of the pathway. 
     a. Ras/RAF/MEK/ERK Pathway: 
     Classic activation of the RAS/Raf/MAPK cascade occurs following ligand binding to a receptor tyrosine kinase at the cell surface, but a vast array of other receptors have the ability to activate the cascade as well, such as integrins, serpentine receptors, heterotrimeric G-proteins, and cytokine receptors. Although conceptually linear, considerable cross talk occurs between the Ras/Raf/MAPK/Erk kinase (MEK)/Erk MAPK pathway and other MAPK pathways as well as many other signaling cascades. The pivotal role of the Ras/Raf/MEK/Erk MAPK pathway in multiple cellular functions underlies the importance of the cascade in oncogenesis and growth of transformed cells. As such, the MAPK pathway has been a focus of intense investigation for therapeutic targeting. Many receptor tyrosine kinases are capable of initiating MAPK signaling. They do so after activating phosphorylation events within their cytoplasmic domains provide docking sites for src-homology 2 (SH2) domain-containing signaling molecules. Of these, adaptor proteins such as Grb2 recruit guanine nucleotide exchange factors such as SOS-1 or CDC25 to the cell membrane. The guanine nucleotide exchange factor is now capable of interacting with Ras proteins at the cell membrane to promote a conformational change and the exchange of GDP for GTP bound to Ras. Multiple Ras isoforms have been described, including K-Ras, N-Ras, and H-Ras. Termination of Ras activation occurs upon hydrolysis of RasGTP to RasGDP. Ras proteins have intrinsically low GTPase activity. Thus, the GTPase activity is stimulated by GTPase-activating proteins such as NF-1 GTPase-activating protein/neurofibromin and p120 GTPase activating protein thereby preventing prolonged Ras stimulated signaling. Ras activation is the first step in activation of the MAPK cascade. Following Ras activation, Raf (A-Raf, B-Raf, or Raf-1) is recruited to the cell membrane through binding to Ras and activated in a complex process involving phosphorylation and multiple cofactors that is not completely understood. Raf proteins directly activate MEK1 and MEK2 via phosphorylation of multiple serine residues. MEK1 and MEK2 are themselves tyrosine and threonine/serine dual-specificity kinases that subsequently phosphorylate threonine and tyrosine residues in Erk1 and Erk2 resulting in activation. Although MEK1/2 have no known targets besides Erk proteins, Erk has multiple targets including Elk-1, c-Ets1, c-Ets2, p90RSK1, MNK1, MNK2, and TOB. The cellular functions of Erk are diverse and include regulation of cell proliferation, survival, mitosis, and migration. McCubrey, J.  Roles of the Raf/MEK/ERK pathway in cell growth, malignant transformation and drug resistance . Biochimica et Biophysica Acta. 2007; 1773: 1263-1284, hereby fully incorporated by reference in its entirety for all purposes, Friday and Adjei, Clinical Cancer Research (2008) 14, p 342-346. 
     b c-Jun N-Terminal Kinase (JNK)/Stress-Activated Protein Kinase (SAPK) Pathway: 
     The c-Jun N-terminal kinases (JNKs) were initially described as a family of serine/threonine protein kinases, activated by a range of stress stimuli and able to phosphorylate the N-terminal transactivation domain of the c-Jun transcription factor. This phosphorylation enhances c-Jun dependent transcriptional events in mammalian cells. Further research has revealed three JNK genes (JNK1, JNK2 and JNK3) and their splice-forms as well as the range of external stimuli that lead to JNK activation. JNK1 and JNK2 are ubiquitous, whereas JNK3 is relatively restricted to brain. The predominant MAP2Ks upstream of JNK are MEK4 (MKK4) and MEK7 (MKK7). MAP3Ks with the capacity to activate JNK/SAPKs include MEKKs (MEKK1, -2, -3 and -4), mixed lineage kinases (MLKs, including MLK1-3 and DLK), Tpl2, ASKs, TAOs and TAK1. Knockout studies in several organisms indicate that different MAP3Ks predominate in JNK/SAPK activation in response to different upstream stimuli. The wiring may be comparable to, but perhaps even more complex than, MAP3K selection and control of the ERK1/2 pathway. JNK/SAPKs are activated in response to inflammatory cytokines; environmental stresses, such as heat shock, ionizing radiation, oxidant stress and DNA damage; DNA and protein synthesis inhibition; and growth factors. JNKs phosphorylate transcription factors c-Jun, ATF-2, p53, Elk-1, and nuclear factor of activated T cells (NFAT), which in turn regulate the expression of specific sets of genes to mediate cell proliferation, differentiation or apoptosis. JNK proteins are involved in cytokine production, the inflammatory response, stress-induced and developmentally programmed apoptosis, actin reorganization, cell transformation and metabolism. Raman, M.  Differential regulation and properties of MAPKs . Oncogene. 2007; 26: 3100-3112, hereby fully incorporated by reference in its entirety for all purposes. 
     c. p38 MAPK Pathway: 
     Several independent groups identified the p38 Map kinases, and four p38 family members have been described (α, β, γ, δ). Although the p38 isoforms share about 40% sequence identity with other MAPKs, they share only about 60% identity among themselves, suggesting highly diverse functions. p38 MAPKs respond to a wide range of extracellular cues particularly cellular stressors such as UV radiation, osmotic shock, hypoxia, pro-inflammatory cytokines and less often growth factors. Responding to osmotic shock might be viewed as one of the oldest functions of this pathway, because yeast p38 activates both short and long-term homeostatic mechanisms to osmotic stress. p38 is activated via dual phosphorylation on the TGY motif within its activation loop by its upstream protein kinases MEK3 and MEK6. MEK3/6 are activated by numerous MAP3Ks including MEKK1-4, TAOs, TAK and ASK. p38 MAPK is generally considered to be the most promising MAPK therapeutic target for rheumatoid arthritis as p38 MAPK isoforms have been implicated in the regulation of many of the processes, such as migration and accumulation of leucocytes, production of cytokines and pro-inflammatory mediators and angiogenesis, that promote disease pathogenesis. Further, the p38 MAPK pathway plays a role in cancer, heart and neurodegenerative diseases and may serve as promising therapeutic target. Cuenda, A.  p 38  MAP - Kinases pathway regulation, function, and role in human diseases . Biochimica et Biophysica Acta. 2007; 1773: 1358-1375; Thalhamer et al., Rheumatology 2008; 47:409-414; Roux, P.  ERK and p 38  MAPK - Activated Protein Kinases: a Family of Protein Kinases with Diverse Biological Functions . Microbiology and Molecular Biology Reviews. June, 2004; 320-344 hereby fully incorporated by reference in its entirety for all purposes. 
     Src Family Kinases: 
     Src is the most widely studied member of the largest family of nonreceptor protein tyrosine kinases, known as the Src family kinases (SFKs). Other SFK members include Lyn, Fyn, Lck, Hck, Fgr, Blk, Yrk, and Yes. The Src kinases can be grouped into two sub-categories, those that are ubiquitously expressed (Src, Fyn, and Yes), and those which are found primarily in hematopoietic cells (Lyn, Lck, Hck, Blk, Fgr). (Benati, D.  Src Family Kinases as Potential Therapeutic Targets for Malignancies and Immunological Disorders . Current Medicinal Chemistry. 2008; 15: 1154-1165) SFKs are key messengers in many cellular pathways, including those involved in regulating proliferation, differentiation, survival, motility, and angiogenesis. The activity of SFKs is highly regulated intramolecularly by interactions between the SH2 and SH3 domains and intermolecularly by association with cytoplasmic molecules. This latter activation may be mediated by focal adhesion kinase (FAK) or its molecular partner Crk-associated substrate (CAS), which plays a prominent role in integrin signaling, and by ligand activation of cell surface receptors, e.g. epidermal growth factor receptor (EGFR). These interactions disrupt intramolecular interactions within Src, leading to an open conformation that enables the protein to interact with potential substrates and downstream signaling molecules. Src can also be activated by dephosphorylation of tyrosine residue Y530. Maximal Src activation requires the autophosphorylation of tyrosine residue Y419 (in the human protein) present within the catalytic domain. Elevated Src activity may be caused by increased transcription or by deregulation due to overexpression of upstream growth factor receptors such as EGFR, HER2, platelet-derived growth factor receptor (PDGFR), fibroblast growth factor receptor (FGFR), vascular endothelial growth factor receptor, ephrins, integrin, or FAK. Alternatively, some human tumors show reduced expression of the negative Src regulator, Csk. Increased levels, increased activity, and genetic abnormalities of Src kinases have been implicated in both solid tumor development and leukemias. Ingley, E.  Src family kinases: Regulation of their activities, levels and identification of new pathways . Biochimica et Biophysica Acta. 2008; 1784 56-65, hereby fully incorporated by reference in its entirety for all purposes. Benati and Baldari., Curr Med Chem. 2008; 15(12):1154-65, Finn (2008) Ann Oncol. May 16, hereby fully incorporated by reference in its entirety for all purposes. 
     Janus Kinase (JAK)/Signal Transducers and Activators of Transcription (STAT) Pathway: 
     The JAK/STAT pathway plays a crucial role in mediating the signals from a diverse spectrum of cytokine receptors, growth factor receptors, and G-protein-coupled receptors. Signal transducers and activators of transcription (STAT) proteins play a crucial role in mediating the signals from a diverse spectrum of cytokine receptors growth factor receptors, and G-protein-coupled receptors. STAT directly links cytokine receptor stimulation to gene transcription by acting as both a cytosolic messenger and nuclear transcription factor. In the Janus Kinase (JAK)-STAT pathway, receptor dimerization by ligand binding results in JAK family kinase (JFK) activation and subsequent tyrosine phosphorylation of the receptor, which leads to the recruitment of STAT through the SH2 domain, and the phosphorylation of conserved tyrosine residue. Tyrosine phosphorylated STAT forms a dimer, translocates to the nucleus, and binds to specific DNA elements to activate target gene transcription, which leads to the regulation of cellular proliferation, differentiation, and apoptosis. The entire process is tightly regulated at multiple levels by protein tyrosine phosphatases, suppressors of cytokine signaling and protein inhibitors of activated STAT. In mammals seven members of the STAT family (STAT1, STAT2, STAT3, STAT4, STAT5a, STAT5b and STAT6) have been identified. JAKs contain two symmetrical kinase-like domains; the C-terminal JAK homology 1 (JH1) domain possesses tyrosine kinase function while the immediately adjacent JH2 domain is enzymatically inert but is believed to regulate the activity of JH1. There are four JAK family members: JAK1, JAK2, JAK3 and tyrosine kinase 2 (Tyk2). Expression is ubiquitous for JAK1, JAK2 and TYK2 but restricted to hematopoietic cells for JAK3. Mutations in JAK proteins have been described for several myeloid malignancies. Specific examples include but are not limited to: Somatic JAK3 (e.g. JAK3A572V, JAK3V722I, JAK3P132T) and fusion JAK2 (e.g. ETV6-JAK2, PCM1-JAK2, BCR-JAK2) mutations have respectively been described in acute megakaryocytic leukemia and acute leukemia/chronic myeloid malignancies, JAK2 (V617F, JAK2 exon 12 mutations) and MPL MPLW515L/K/S, MPLS505N) mutations associated with myeloproliferative disorders and myeloproliferative neoplasms. JAK2 mutations, primarily JAK2V617F, are invariably associated with polycythemia vera (PV). This mutation also occurs in the majority of patients with essential thrombocythemia (ET) or primary myelofibrosis (PMF) (Tefferi n., Leukemia &amp; Lymphoma, March 2008; 49(3): 388-397). STATs can be activated in a JAK-independent manner by src family kinase members and by oncogenic FLt3 ligand-ITD (Hayakawa and Naoe, Ann N Y Acad Sci. 2006 November; 1086:213-22; Choudhary et al. Activation mechanisms of STAT5 by oncogenic FLt3 ligand-ITD. Blood (2007) vol. 110 (1) pp. 370-4). Although mutations of STATs have not been described in human tumors, the activity of several members of the family, such as STAT1, STAT3 and STAT5, is dysregulated in a variety of human tumors and leukemias. STAT3 and STAT5 acquire oncogenic potential through constitutive phosphorylation on tyrosine, and their activity has been shown to be required to sustain a transformed phenotype. This was shown in lung cancer where tyrosine phosphorylation of STAT3 was JAK-independent and mediated by EGF receptor activated through mutation and Src. (Alvarez et al., Cancer Research, Cancer Res 2006; 66) STAT5 phosphorylation was also shown to be required for the long-term maintenance of leukemic stem cells. (Schepers et al. STAT5 is required for long-term maintenance of normal and leukemic human stem/progenitor cells. Blood (2007) vol. 110 (8) pp. 2880-2888) In contrast to STAT3 and STAT5, STAT1 negatively regulates cell proliferation and angiogenesis and thereby inhibits tumor formation. Consistent with its tumor suppressive properties, STAT1 and its downstream targets have been shown to be reduced in a variety of human tumors (Rawlings, J. The JAK/STAT signaling pathway. J of Cell Science. 2004; 117 (8): 1281-1283, hereby fully incorporated by reference in its entirety for all purposes). 
     Drug Transporters 
     A key issue in the treatment of many cancers is the development of resistance to chemotherapeutic drugs. Of the many resistance mechanisms, two classes of transporters play a major role. The human ATP-binding cassette (ABC) superfamily of proteins consists of 49 membrane proteins that transport a diverse array of substrates, including sugars, amino acids, bile salts lipids, sterols, nucleotides, endogenous metabolites, ions, antibiotics drugs and toxins out of cells using the energy of hydrolysis of ATP. ATP-binding-cassette (ABC) transporters are evolutionary extremely well-conserved transmembrane proteins that are highly expressed in hematopoietic stem cells (HSCs). The physiological function in human stem cells is believed to be protection against genetic damage caused by both environmental and naturally occurring xenobiotics. Additionally, ABC transporters have been implicated in the maintenance of quiescence and cell fate decisions of stem cells. These physiological roles suggest a potential role in the pathogenesis and biology of stem cell-derived hematological malignancies such as acute and chronic myeloid leukemia (Raaijmakers, Leukemia (2007) 21, 2094-2102, Zhou et al., Nature Medicine, 2001, 7, p 1028-1034 
     Several ABC proteins are multidrug efflux pumps that not only protect the body from exogenous toxins, but also play a role in uptake and distribution of therapeutic drugs. Expression of these proteins in target tissues causes resistance to treatment with multiple drugs. (Gillet et al., Biochimica et Biophysica Acta (2007) 1775, p 237, Sharom (2008) Pharmacogenomics 9 p 105). A more detailed discussion of the ABC family members with critical roles in resistance and poor outcome to treatment is discussed below 
     The second class of plasma membrane transporter proteins that play a role in the uptake of nucleoside-derived drugs are the Concentrative and Equilibrative Nucleoside Transporters (CNT and ENT, respectively), encoded by gene families SLC28 and SLC29 (Pastor-Anglada (2007) J. Physiol. Biochem 63, p 97). They mediate the uptake of natural nucleosides and a variety of nucleoside-derived drugs, mostly used in anti-cancer therapy. In vitro studies, have shown that one mechanism of nucleoside resistance can be mediated through mutations in the gene for ENT1/SLC29A1 resulting in lack of detectable protein (Cai et al., Cancer Research (2008) 68, p 2349). Studies have also described in vivo mechanisms of resistance to nucleoside analogues involving low or non-detectable levels of ENT1 in Acute Myeloid Leukemia (AML), Mantle Cell lymphoma and other leukemias (Marce et al., Malignant Lymphomas (2006), 91, p 895). 
     Of the ABC transporter family, three family members account for most of the multiple drug resistance (MDR) in humans; P-gycoprotein (Pgp/MDR1/ABCB 1), MDR-associated protein (MRP1, ABCC1) and breast cancer resistance protein (BCRP, ABCG2 or MXR). Pgp/MDR1 and ABCG2 can export both unmodified drugs and drug conjugates, whereas MRP1 exports glutathione and other drug conjugates as well as unconjugated drugs together with free glutathione. All three ABC transporters demonstrate export activity for a broad range of structurally unrelated drugs and display both distinct and overlapping specificities. For example, MRP1 promotes efflux of drug-glutathione conjugates, vinca alkaloids, camptothecin, but not taxol. Examples of drugs exported by ABCG2 include mitoxantrone, etoposide, daunorubicin as well as the tyrosine kinase inhibitors Gleevec and Iressa. In treatment regimens for leukemias, one of the main obstacles to achieving remission is intrinsic and acquired resistance to chemotherapy mediated by the ABC drug transporters. Several reports have described correlations between transporter expression levels as well as their function, evaluated through the use of fluorescent dyes, with resistance of patients to chemotherapy regimens. Notably, in AML, studies have shown that expression of Pgp/MDR1 is associated with a lower rate of complete response to induction chemotherapy and a higher rate of resistant disease in both elderly and younger AML patients (Leith et al., Blood (1997) 89 p 3323, Leith et al., Blood (1999) 94, p 1086). Legrand et al., (Blood (1998) 91, p4480) showed that Pgp/MDR1 and MRP1 function in CD34+ blast cells are negative prognostic factors in AML and further, the same group showed that a high level of simultaneous activity of Pgp/MDR1 and MRP1 was predictive of poor treatment outcome (Legrand et al., (Blood (1999) 94, p 10 46 ). In two more recent studies, elevated expression of Pgp/MDR1 and BCRP in CD34+/CD38− AML subpopulations were found in 8 out of 10 non-responders as compared to 0 out of 10 in responders to induction chemotherapy (Ho et al., Experimental Hematology (2008) 36, p 433). In a second study, evaluation of Pgp/MDR1, MRP1, BCRP/ABCG2 and lung resistance protein showed that the more immature subsets of leukemic stem cells expressed higher levels of these proteins compared more mature leukemic subsets (Figueiredo-Pontes et al., Clinical Cytometry (2008) 74B p163). 
     Experimentally, it is possible to correlate expression of transporter proteins with their function by the use of inhibitors including but not limited to cyclosporine (measures Pgp function), probenecid (measures MRP1 function), fumitremorgin C, and a derivative Ko143, reserpine (measures ABCG2 function). Although these molecules inhibit a variety of transporters, they do permit some correlations to be made between protein expression and function (Legrand et al., (Blood (1998) 91, p 4480), Legrand et al., (Blood (1999) 94, p 1046, Zhou et al., Nature Medicine, 2001, 7, p 1028-1034, Sarkardi et al., Physiol Rev 2006 86: 1179-1236). 
     Extending the use of these inhibitors, they can be used to make correlations within subpopulations of cells gated both for phenotypic markers denoting stages of development along hematopoietic and lymphoid lineages, as well as reagents that recognize the transporter proteins themselves. Thus it will be possible to simultaneously measure protein expression and function. 
     Expression levels of drug transporters and receptors may not be as informative by themselves for disease management as analysis of activatable elements, such as phosphorylated proteins. However, expression information may be useful in combination with the analysis of activatable elements, such as phosphorylated proteins. In some embodiments, the methods described herein analyze the expression of drug transporters and receptors in combination with the analysis of one or more activatable elements for the diagnosis, prognosis, selection of treatment, or predicting response to treatment for a condition. 
     DNA Damage and Apoptosis 
     The response to DNA damage is a protective measure taken by cells to prevent or delay genetic instability and tumorigenesis. It allows cells to undergo cell cycle arrest and gives them an opportunity to either: repair the broken DNA and resume passage through the cell cycle or, if the breakage is irreparable, trigger senescence or an apoptotic program leading to cell death (Wade Harper et al., Molecular Cell, (2007) 28 p 739-745, Bartek J et al., Oncogene (2007)26 p 7773-9). See also U.S. Ser. No. 61/436,534 and PCT/US2011/48332 which are both incorporated by reference in their entireties for all purposes. 
     Several protein complexes are positioned at strategic points within the DNA damage response pathway and act as sensors, transducers or effectors of DNA damage. Depending on the nature of DNA damage for example; double stranded breaks, single strand breaks, single base alterations due to alkylation, oxidation etc, there is an assembly of specific DNA damage sensor protein complexes in which activated ataxia telangiectasia mutated (ATM) and ATM- and Rad3 related (ATR) kinases phosphorylate and subsequently activate the checkpoint kinases Chk1 and Chk2. Both of these DNA-signal transducer kinases amplify the damage response by phosphorylating a multitude of substrates. Both checkpoint kinases have overlapping and distinct roles in orchestrating the cell&#39;s response to DNA damage. 
     Maximal kinase activation of Chk2 involves phosphorylation and homo-dimerization with ATM-mediated phosphorylation of T68 on Chk2 as a preliminary event. This in turn activates the DNA repair. As mentioned above, in order for DNA repair to proceed, there must be a delay in the cell cycle. Chk2 seems to have a role at the G1/S and G2/M junctures and may have overlapping functions with Chk. There are multiple ways in which Chk1 and Chk2 mediate cell cycle suspension. In one mechanism Chk2 phosphorylates the CDC25A and CDC25C phosphatases resulting in their removal from the nucleus either by proteosomal degradation or by sequestration in the cytoplasm by 14-3-3. These phosphatases are no longer able to act on their nuclear CDK substrates. If DNA repair is successful cell cycle progression is resumed (Antoni et al., Nature reviews cancer (2007) 7, p 925-936). 
     When DNA repair is no longer possible the cell undergoes apoptosis with participation from Chk2 in p53 independent and dependent pathways. Chk2 substrates that operate in a p53-independent manner include the E2F1 transcription factor, the tumor suppressor promyelocytic leukemia (PML) and the polo-like kinases 1 and 3 (PLK1 and PLK3). E2F1 drives the expression of a number of apoptotic genes including caspases 3, 7, 8 and 9 as well as the pro-apoptotic Bcl-2 related proteins (Bim, Noxa, PUMA). 
     In its response to DNA damage, the p53 activates the transcription of a program of genes that regulate DNA repair, cell cycle arrest, senescence and apoptosis. The overall functions of p53 are to preserve fidelity in DNA replication such that when cell division occurs tumorigenic potential can be avoided. In such a role, p53 is described as “The Guardian of the Genome (Riley et al., Nature Reviews Molecular Cell Biology (2008) 9 p 402-412). The diverse alarm signals that impinge on p53 result in a rapid increase in its levels through a variety of post translational modifications. Worthy of mention is the phosphorylation of amino acid residues within the amino terminal portion of p53 such that p53 is no longer under the regulation of Mdm2. The responsible kinases are ATM, Chk1 and Chk2. The subsequent stabilization of p53 permits it to transcriptionally regulate multiple pro-apoptotic members of the Bcl-2 family, including Bax, Bid, Puma, and Noxa (discussion below). 
     The series of events that are mediated by p53 to promote apoptosis including DNA damage, anoxia and imbalances in growth-promoting signals are sometimes termed the ‘intrinsic apoptotic” program since the signals triggering it originate within the cell. An alternate route of activating the apoptotic pathway can occur from the outside of the cell mediated by the binding of ligands to transmembrane death receptors. This extrinsic or receptor mediated apoptotic program acting through their receptor death domains eventually converges on the intrinsic, mitochondrial apoptotic pathway as discussed below (Sprick et al., Biochim Biophys Acta. (2004) 1644 p 125-32). 
     Key regulators of apoptosis are proteins of the Bcl-2 family. The founding member, the Bcl-2 proto-oncogene was first identified at the chromosomal breakpoint of t(14:18) bearing human follicular B cell lymphoma. Unexpectedly, expression of Bcl-2 was proved to block rather than promote cell death following multiple pathological and physiological stimuli (Danial and Korsemeyer, Cell (2204) 116, p 205-219). The Bcl-2 family has at least 20 members which are key regulators of apoptosis, functioning to control mitochondrial permeability as well as the release of proteins important in the apoptotic program. The ratio of anti- to pro-apoptotic molecules such as Bcl-2/Bax constitutes a rheostat that sets the threshold of susceptibility to apoptosis for the intrinsic pathway, which utilizes organelles such as the mitochondrion to amplify death signals. The family can be divided into 3 subclasses based on structure and impact on apoptosis. Family members of subclass 1 including Bcl-2, Bcl-X L  and Mcl-1 are characterized by the presence of 4 Bcl-2 homology domains (BH1, BH2, BH3 and BH4) and are anti-apoptotic. The structure of the second subclass members is marked for containing 3 BH domains and family members such as Bax and Bak possess pro-apoptotic activities. The third subclass, termed the BH3-only proteins include Noxa, Puma, Bid, Bad and Bim. They function to promote apoptosis either by activating the pro-apoptotic members of group 2 or by inhibiting the anti-apoptotic members of subclass 1 (Er et al., Biochimica et Biophysica Act (2006) 1757, p 1301-1311, Fernandez-Luna Cellular Signaling (2008) Advance Publication Online). 
     The role of mitochondria in the apoptotic process was clarified as involving an apoptotic stimulus resulting in depolarization of the outer mitochondrial membrane leading to a leak of cytochrome C into the cytoplasm. Association of Cytoplasmic cytochrome C molecules with adaptor apoptotic protease activating factor (APAF) forms a structure called the apoptosome which can activate enzymatically latent procaspase 9 into a cleaved activated form. Caspase 9 is one member of a family of cysteine aspartyl-specific proteases; genes encoding 11 of these proteases have been mapped in the human genome. Activated caspase 9, classified as an intiator caspase, then cleaves procaspase 3 which cleaves more downstream procaspases, classified as executioner caspases, resulting in an amplification cascade that promotes cleavage of death substrates including poly(ADP-ribose) polymerase 1 (PARP). The cleavage of PARP produces 2 fragments both of which have a role in apoptosis (Soldani and Scovassi Apoptosis (2002) 7, p 321). A further level of apoptotic regulation is provided by smac/Diablo, a mitochondrial protein that inactivates a group of anti-apoptotic proteins termed inhibitors of apoptosis (IAPs) (Huang et al., Cancer Cell (2004) 5 p 1-2). IAPs operate to block caspase activity in 2 ways; they bind directly to and inhibit caspase activity and in certain cases they can mark caspases for ubiquitination and degradation. 
     Members of the caspase gene family (cysteine proteases with aspartate specificity) play significant roles in both inflammation and apoptosis. Caspases exhibit catalytic and substrate recognition motifs that have been highly conserved. These characteristic amino acid sequences allow caspases to interact with both positive and negative regulators of their activity. The substrate preferences or specificities of individual caspases have been exploited for the development of peptides that successfully compete for caspase binding. In addition to their distinctive aspartate cleavage sites at the P1 position, the catalytic domains of the caspases require at least four amino acids to the left of the cleavage site with P4 as the prominent specificity-determining residue. WEHD, VDVAD, and DEVD are examples of peptides that preferentially bind caspase-1, caspase-2 and caspase-3, respectively. It is possible to generate reversible or irreversible inhibitors of caspase activation by coupling caspase-specific peptides to certain aldehyde, nitrile or ketone compounds. These caspase inhibitors can successfully inhibit the induction of apoptosis in various tumor cell lines as well as normal cells. Fluoromethyl ketone (FMK)-derivatized peptides act as effective irreversible inhibitors with no added cytotoxic effects. Inhibitors synthesized with a benzyloxycarbonyl group (also known as BOC or Z) at the N-terminus and O-methyl side chains exhibit enhanced cellular permeability thus facilitating their use in both in vitro cell culture as well as in vivo animal studies. Benzyloxycarbonyl-Val-Ala-Asp (OMe) fluoromethylketone (ZVAD) is a caspase inhibitor. See Misaghi, et al., z-VAD-fmk inhibits peptide:N-glycanase and may result in ER stress Cell Death and Differentiation (2006) 13, 163-165. 
     The balance of pro- and anti-apoptotic proteins is tightly regulated under normal physiological conditions. Tipping of this balance either way results in disease. An oncogenic outcome results from the inability of tumor cells to undergo apoptosis and this can be caused by over-expression of anti-apoptotic proteins or reduced expression or activity of pro-apoptotic protein. 
       FIG. 3  shows the role of apoptosis in AML. 
     In some embodiments, the status of an activatable element within an apoptosis pathway in response to a modulator that slows or stops the growth of cells and/or induces apoptosis of cells is determined. In some embodiments, the activatable element within the apoptosis pathway is selected from the group consisting of Cleaved PARP (PARP+), Cleaved Caspase 8, and Cytoplasmic Cytochrome C, and the modulator that slows or stops the growth of cells and/or induces apoptosis of cells is selected from the group consisting of Staurosporine, Etoposide, Mylotarg, Daunorubicin, and AraC. 
     In some embodiments, the status of an activatable element within a DNA damage pathway in response to a modulator that slows or stops the growth of cells and/or induces apoptosis of cells is determined. In some embodiments, the activatable element within a DNA damage pathway is selected from the group consisting of Chk1, Chk2, ATM, and ATR and the modulator that slows or stops the growth of cells and/or induces apoptosis of cells is selected from the group consisting of Staurosporine, Etoposide, Mylotarg, Daunorubicin, and AraC. 
     In some embodiments, interrogation of the apoptotic machinery will also be performed by etoposide with or without ZVAD, an inhibitor of caspases, or a combination of Cytarabine and Daunorubicin at clinically relevant concentrations based on peak plasma drug levels. The standard dose of Cytarabine, 100 mg/m2, yields a peak plasma concentration of approximately 40 nM, whereas high dose Cytarabine, 3 g/m2, yields a peak plasma concentration of 2 uM. Daunorubicin at 25 mg/m2 yields a peak plasma concentration of 50 ng/ml and at 50 mg/m2 yields a peak plasma concentration of 200 ng/ml. Our in vitro apoptosis assay will use concentrations of Cytarabine up to 2 uM, and concentrations of Daunorubicin up to 200 ng/ml. 
     Etoposide phosphate (brand names: Eposin, Etopophos, Vepesid, VP-16) is an inhibitor of the enzyme topoisomerase II and a semisynthetic derivative of podophyllotoxin, a substance extracted from the mandrake root  Podophyllum peltatum . Possessing potent antineoplastic properties, etoposide binds to and inhibits topoisomerase II and its function in ligating cleaved DNA molecules, resulting in the accumulation of single- or double-strand DNA breaks, the inhibition of DNA replication and transcription, and apoptotic cell death. Etoposide acts primarily in the G2 and S phases of the cell cycle. See the NCI Drug Dictionary at http://www.cancer.gov/Templates/drugdictionary.aspx?CdrID=39207. 
     Cell Cycle 
     The cell cycle, or cell-division cycle, is the series of events that take place in a cell leading to its division and duplication (replication). The cell cycle consists of five distinct phases: G1 phase, S phase (synthesis), G2 phase (collectively known as interphase) and M phase (mitosis). M phase is itself composed of two tightly coupled processes: mitosis, in which the cell&#39;s chromosomes are divided between the two daughter cells, and cytokinesis, in which the cell&#39;s cytoplasm divides forming distinct cells. Activation of each phase is dependent on the proper progression and completion of the previous one. Cells that have temporarily or reversibly stopped dividing are said to have entered a state of quiescence called G0 phase. 
     Regulation of the cell cycle involves processes crucial to the survival of a cell, including the detection and repair of genetic damage as well as the prevention of uncontrolled cell division. The molecular events that control the cell cycle are ordered and directional; that is, each process occurs in a sequential fashion and it is impossible to “reverse” the cycle. 
     Two key classes of regulatory molecules, cyclins and cyclin-dependent kinases (CDKs), determine a cell&#39;s progress through the cell cycle. Many of the genes encoding cyclins and CDKs are conserved among all eukaryotes, but in general more complex organisms have more elaborate cell cycle control systems that incorporate more individual components. Many of the relevant genes were first identified by studying yeast, especially  Saccharomyces cerevisiae  genetic nomenclature in yeast dubs many these genes cdc (for “cell division cycle”) followed by an identifying number, e.g., cdc25. 
     Cyclins form the regulatory subunits and CDKs the catalytic subunits of an activated heterodimer; cyclins have no catalytic activity and CDKs are inactive in the absence of a partner cyclin. When activated by a bound cyclin, CDKs perform a common biochemical reaction called phosphorylation that activates or inactivates target proteins to orchestrate coordinated entry into the next phase of the cell cycle. Different cyclin-CDK combinations determine the downstream proteins targeted. CDKs are constitutively expressed in cells whereas cyclins are synthesised at specific stages of the cell cycle, in response to various molecular signals. 
     Upon receiving a pro-mitotic extracellular signal, G1 cyclin-CDK complexes become active to prepare the cell for S phase, promoting the expression of transcription factors that in turn promote the expression of S cyclins and of enzymes required for DNA replication. The G1 cyclin-CDK complexes also promote the degradation of molecules that function as S phase inhibitors by targeting them for ubiquitination. Once a protein has been ubiquitinated, it is targeted for proteolytic degradation by the proteasome. Active S cyclin-CDK complexes phosphorylate proteins that make up the pre-replication complexes assembled during G1 phase on DNA replication origins. The phosphorylation serves two purposes: to activate each already-assembled pre-replication complex, and to prevent new complexes from forming. This ensures that every portion of the cell&#39;s genome will be replicated once and only once. The reason for prevention of gaps in replication is fairly clear, because daughter cells that are missing all or part of crucial genes will die. However, for reasons related to gene copy number effects, possession of extra copies of certain genes would also prove deleterious to the daughter cells. 
     Mitotic cyclin-CDK complexes, which are synthesized but inactivated during S and G2 phases, promote the initiation of mitosis by stimulating downstream proteins involved in chromosome condensation and mitotic spindle assembly. A critical complex activated during this process is an ubiquitin ligase known as the anaphase-promoting complex (APC), which promotes degradation of structural proteins associated with the chromosomal kinetochore. APC also targets the mitotic cyclins for degradation, ensuring that telophase and cytokinesis can proceed. Interphase: Interphase generally lasts at least 12 to 24 hours in mammalian tissue. During this period, the cell is constantly synthesizing RNA, producing protein and growing in size. By studying molecular events in cells, scientists have determined that interphase can be divided into 4 steps: Gap 0 (G0), Gap 1 (G1), S (synthesis) phase, Gap 2 (G2). 
     Cyclin D is the first cyclin produced in the cell cycle, in response to extracellular signals (e.g. growth factors). Cyclin D binds to existing CDK4, forming the active cyclin D-CDK4 complex. Cyclin D-CDK4 complex in turn phosphorylates the retinoblastoma susceptibility protein (Rb). The hyperphosphorylated Rb dissociates from the E2F/DP 1/Rb complex (which was bound to the E2F responsive genes, effectively “blocking” them from transcription), activating E2F. Activation of E2F results in transcription of various genes like cyclin E, cyclin A, DNA polymerase, thymidine kinase, etc. Cyclin E thus produced binds to CDK2, forming the cyclin E-CDK2 complex, which pushes the cell from G1 to S phase (G1/S transition). Cyclin B along with cdc2 (cdc2—fission yeasts (CDK1—mammalia)) forms the cyclin B-cdc2 complex, which initiates the G2/M transition. Cyclin B-cdc2 complex activation causes breakdown of nuclear envelope and initiation of prophase, and subsequently, its deactivation causes the cell to exit mitosis. 
     Two families of genes, the Cip/Kip family and the INK4a/ARF (Inhibitor of Kinase 4/Alternative Reading Frame) prevent the progression of the cell cycle. Because these genes are instrumental in prevention of tumor formation, they are known as tumor suppressors. 
     The Cip/Kip family includes the genes p21, p27 and p57. They halt cell cycle in G1 phase, by binding to, and inactivating, cyclin-CDK complexes. p21 is a p53 response gene (which, in turn, is triggered by DNA damage eg. due to radiation). p27 is activated by Transforming Growth Factor 0 (TGF β), a growth inhibitor. 
     The INK4a/ARF family includes p16INK4a, which binds to CDK4 and arrests the cell cycle in G1 phase, and p14arf which prevents p53 degradation. 
     Cell cycle checkpoints are used by the cell to monitor and regulate the progress of the cell cycle. Checkpoints prevent cell cycle progression at specific points, allowing verification of necessary phase processes and repair of DNA damage. The cell cannot proceed to the next phase until checkpoint requirements have been met. 
     Several checkpoints are designed to ensure that damaged or incomplete DNA is not passed on to daughter cells. Two main checkpoints exist: the G1/S checkpoint and the G2/M checkpoint. G1/S transition is a rate-limiting step in the cell cycle and is also known as restriction point. An alternative model of the cell cycle response to DNA damage has also been proposed, known as the postreplication checkpoint. p53 plays an important role in triggering the control mechanisms at both G1/S and G2/M checkpoints. 
     A disregulation of the cell cycle components may lead to tumor formation. As mentioned above, some genes like the cell cycle inhibitors, RB, p53 etc., when they mutate, may cause the cell to multiply uncontrollably, forming a tumor. Although the duration of cell cycle in tumor cells is equal to or longer than that of normal cell cycle, the proportion of cells that are in active cell division (versus quiescent cells in G0 phase) in tumors is much higher than that in normal tissue. Thus there is a net increase in cell number as the number of cells that die by apoptosis or senescence remains the same. 
     In some embodiments, the status of an activatable element within a cell cycle pathway in response to a modulator that slows or stops the growth of cells and/or induces apoptosis of cells is determined. In some embodiments, the activatable element within a DNA damage pathway is selected from the group consisting of, Cdc25, p53, CyclinA-Cdk2, CyclinE-Cdk2, CyclinB-Cdk1, p21, and Gadd45. In some embodiments, the modulator that slows or stops the growth of cells and/or induces apoptosis of cells is selected from the group consisting of Staurosporine, Etoposide, Mylotarg, Daunorubicin, and AraC. 
     Modulators 
     In some embodiments, the methods and composition utilize a modulator. A modulator can be an activator, a therapeutic compound, an inhibitor or a compound capable of impacting a cellular pathway. Modulators can also take the form of environmental cues and inputs. 
     Modulation can be performed in a variety of environments. In some embodiments, cells are exposed to a modulator immediately after collection. In some embodiments where there is a mixed population of cells, purification of cells is performed after modulation. In some embodiments, whole blood is collected to which a modulator is added. In some embodiments, cells are modulated after processing for single cells or purified fractions of single cells. As an illustrative example, whole blood can be collected and processed for an enriched fraction of lymphocytes that is then exposed to a modulator. Modulation can include exposing cells to more than one modulator. For instance, in some embodiments, a sample of cells is exposed to at least 2, 3, 4, 5, 6, 7, 8, 9, or 10 or more modulators. See U.S. patent application Ser. Nos. 12/432,239 and 12/910,769 which are incorporated by reference in their entireties. See also U.S. Pat. Nos. 7,695,926 and 7,381,535 and U.S. Pub. No. 2009/0269773. 
     In some embodiments, cells are cultured post collection in a suitable media before exposure to a modulator. In some embodiments, the media is a growth media. In some embodiments, the growth media is a complex media that may include serum. In some embodiments, the growth media comprises serum. In some embodiments, the serum is selected from the group consisting of fetal bovine serum, bovine serum, human serum, porcine serum, horse serum, and goat serum. In some embodiments, the serum level ranges from 0.0001% to 30%, about 0.001% to 30%, about 0.01% to 30%, about 0.1% to 30% or 1% to 30%. In some embodiments, the growth media is a chemically defined minimal media and is without serum. In some embodiments, cells are cultured in a differentiating media. 
     Modulators include chemical and biological entities, and physical or environmental stimuli. Modulators can act extracellularly or intracellularly. Chemical and biological modulators include growth factors, mitogens, cytokines, drugs, immune modulators, ions, neurotransmitters, adhesion molecules, hormones, small molecules, inorganic compounds, polynucleotides, antibodies, natural compounds, lectins, lactones, chemotherapeutic agents, biological response modifiers, carbohydrate, proteases and free radicals. Modulators include complex and undefined biologic compositions that may comprise cellular or botanical extracts, cellular or glandular secretions, physiologic fluids such as serum, amniotic fluid, or venom. Physical and environmental stimuli include electromagnetic, ultraviolet, infrared or particulate radiation, redox potential and pH, the presence or absences of nutrients, changes in temperature, changes in oxygen partial pressure, changes in ion concentrations and the application of oxidative stress. Modulators can be endogenous or exogenous and may produce different effects depending on the concentration and duration of exposure to the single cells or whether they are used in combination or sequentially with other modulators. Modulators can act directly on the activatable elements or indirectly through the interaction with one or more intermediary biomolecule. Indirect modulation includes alterations of gene expression wherein the expressed gene product is the activatable element or is a modulator of the activatable element. 
     In some embodiments the modulator is selected from the group consisting of growth factors, mitogens, cytokines, adhesion molecules, drugs, hormones, small molecules, polynucleotides, antibodies, natural compounds, lactones, chemotherapeutic agents, immune modulators, carbohydrates, proteases, ions, reactive oxygen species, peptides, and protein fragments, either alone or in the context of cells, cells themselves, viruses, and biological and non-biological complexes (e.g. beads, plates, viral envelopes, antigen presentation molecules such as major histocompatibility complex). In some embodiments, the modulator is a physical stimuli such as heat, cold, UV radiation, and radiation. Examples of modulators, include but are not limited to Growth factors, such as Adrenomedullin (AM), Angiopoietin (Ang), Autocrine motility factor, Bone morphogenetic proteins (BMPs), Brain-derived neurotrophic factor (BDNF), Epidermal growth factor (EGF), Erythropoietin (EPO), Fibroblast growth factor (FGF), Glial cell line-derived neurotrophic factor (GDNF), Granulocyte colony-stimulating factor (G-CSF), Granulocyte macrophage colony-stimulating factor (GM-CSF), Growth differentiation factor-9 (GDF9), Hepatocyte growth factor (HGF), Hepatoma-derived growth factor (HDGF), Insulin-like growth factor (IGF), Migration-stimulating factor, Myostatin (GDF-8), Nerve growth factor (NGF) and other neurotrophins, Platelet-derived growth factor (PDGF), Stromal Derived Growth Factor, (SDGF), Thrombopoietin (TPO), Transforming growth factor alpha (TGF-α), Transforming growth factor beta (TGF-β), Tumour necrosis factor-alpha (TNF-α), Vascular endothelial growth factor (VEGF), Keratin Derived Growth Factor (KGF), Wnt Signaling Pathway, placental growth factor (PlGF), [(Foetal Bovine Somatotrophin)] (FBS), IL-1—Cofactor for IL-3 and IL-6. Activates T cells, IL-2—T-cell growth factor. Stimulates IL-1 synthesis. Activates B-cells and NK cells, IL-3—Stimulates production of all non-lymphoid cells, IL-4—Growth factor for activated B cells, resting T cells, and mast cells, IL-5—Induces differentiation of activated B cells and eosinophils, IL-6—Stimulates Ig synthesis. Growth factor for plasma cells, and IL-7—Growth factor for pre-B cells. Cell motility factors, such as peptide growth factors, (e.g., EGF, PDGF, TGF-beta), substrate-adhesion molecules (e.g., fibronectin, laminin), cell adhesion molecules (CAMs), and metalloproteinases, hepatocyte growth factor (HGF) or scatter factor (SF), autocrine motility factor (AMF), and migration-stimulating factor (MSF). Other modulators include SDF-1α, IFN-α, IFN-γ, IL-10, IL-6, IL-27, G-CSF, FLT-3L, IGF-1, M-CSF, SCF, PMA, Thapsigargin, H 2 O 2 , Etoposide, Mylotarg, AraC, daunorubicin, staurosporine, benzyloxycarbonyl-Val-Ala-Asp (OMe) fluoromethylketone (ZVAD), lenalidomide, EPO, azacitadine, decitabine, IL-3, IL-4, GM-CSF, EPO, LPS, TNF-α, and CD40L. 
     In some embodiments, the modulator is an activator. In some embodiments the modulator is an inhibitor. In some embodiments, cells are exposed to one or more modulators. In some embodiments, cells are exposed to at least 2, 3, 4, 5, 6, 7, 8, 9, or 10 modulators. In some embodiments, cells are exposed to at least two modulators, wherein one modulator is an activator and one modulator is an inhibitor. In some embodiments, cells are exposed to at least 2, 3, 4, 5, 6, 7, 8, 9, or 10 modulators, where at least one of the modulators is an inhibitor. 
     In some embodiments, the cross-linker is a molecular binding entity. In some embodiments, the molecular binding entity is a monovalent, bivalent, or multivalent is made more multivalent by attachment to a solid surface or tethered on a nanoparticle surface to increase the local valency of the epitope binding domain. 
     In some embodiments, the inhibitor is an inhibitor of a cellular factor or a plurality of factors that participates in a cellular pathway (e.g. signaling cascade) in the cell. In some embodiments, the inhibitor is a phosphataseor a tyrosine kinase inhibitor. Examples of phosphatase inhibitors include, but are not limited to H 2 O 2 , siRNA, miRNA, Cantharidin, (−)-p-Bromotetramisole, Microcystin LR, Sodium Orthovanadate, Sodium Pervanadate, Vanadyl sulfate, Sodium oxodiperoxo(1,10-phenanthroline)vanadate, bis(maltolato)oxovanadium(IV), Sodium Molybdate, Sodium Perm olybdate, Sodium Tartrate, Imidazole, Sodium Fluoride, β-Glycerophosphate, Sodium Pyrophosphate Decahydrate, Calyculin A, Discodermia calyx, bpV(phen), mpV(pic), DMHV, Cypermethrin, Dephostatin, Okadaic Acid, NIPP-1, N-(9,10-Dioxo-9,10-dihydro-phenanthren-2-yl)-2,2-dimethyl-propionamide, α-Bromo-4-hydroxyacetophenone, 4-Hydroxyphenacyl Br, α-Bromo-4-methoxyacetophenone, 4-Methoxyphenacyl Br, α-Bromo-4-(carboxymethoxy)acetophenone, 4-(Carboxymethoxy)phenacyl Br, and bis(4-Trifluoromethylsulfonamidophenyl)-1,4-diisopropylbenzene, phenylarsine oxide, Pyrrolidine Dithiocarbamate, and Aluminium fluoride. In some embodiments, the phosphatase inhibitor is H 2 O 2 . 
     In some embodiments, the activation level of an activatable element in a cell is determined by contacting the cell with an inhibitor and a modulator, where the modulator can be an inhibitor or an activator. In some embodiments, the activation level of an activatable element in a cell is determined by contacting the cell with an inhibitor and an activator. In some embodiments, the activation level of an activatable element in a cell is determined by contacting the cell with two or more modulators. 
     In some embodiments, a phenotypic profile of a population of cells is determined by measuring the activation level of an activatable element when the population of cells is exposed to a plurality of modulators in separate cultures. In some embodiments, the modulators include H 2 O 2 , PMA, SDF1 α, CD40L, IGF-1, IL-7, IL-6, IL-10, IL-27, IL-4, IL-2, IL-3, thapsigargin and/or a combination thereof. For instance a population of cells can be exposed to one or more, all or a combination of the following combination of modulators: H 2 O 2 ; PMA; SDF1α; CD40L; IGF-1; IL-7; IL-6; IL-10; IL-27; IL-4; IL-2; IL-3; thapsigargin. In some embodiments, the phenotypic profile of the population of cells is used to classify the population as described herein. 
     In one embodiment, the modulator is etoposide phosphate. Etoposide phosphate (brand names: Eposin, Etopophos, Vepesid, VP-16) can inhibit enzyme topoisomerase II. Etoposide phosphate is a semisynthetic derivative of podophyllotoxin, a substance extracted from the mandrake root  Podophyllum peltatum . Etoposide can possess antineoplastic properties. Etoposide can bind to and inhibit topoisomerase II and its function in ligating cleaved DNA molecules, resulting in the accumulation of single- or double-strand DNA breaks, the inhibition of DNA replication and transcription, and apoptotic cell death. Etoposide can act primarily in the G2 and S phases of the cell cycle. See the NCI Drug Dictionary at http(dcolon, slash, slash)www.cancer.gov(slash)Templates/drugdictionary.aspx?CdrID=39207. 
     In one embodiment, the modulator is Mylotarg. Mylotarg® (gemtuzumab ozogamicin for Injection) is a chemotherapy agent composed of a recombinant humanized IgG4, kappa antibody conjugated with a cytotoxic antitumor antibiotic, calicheamicin, isolated from fermentation of a bacterium,  Micromonospora echinospora  subsp.  calichensis . The antibody portion of Mylotarg can bind specifically to the CD33 antigen, a sialic acid-dependent adhesion protein found on the surface of leukemic blasts and immature normal cells of myelomonocytic lineage, but not on normal hematopoietic stem cells. See U.S. Pat. Nos. 7,727,968, 5,773,001, and 5,714,586. 
     In one embodiment, the modulator is staurosporine. Staurosporine (antibiotic AM-2282 or STS) is a natural product originally isolated in 1977 from bacterium  Streptomyces staurosporeus . Staurosporine can have biological activities ranging from anti-fungal to anti-hypertensive. See e.g., Rüegg U T, Burgess G M. (1989) Staurosporine, K-252 and UCN-01: potent but nonspecific inhibitors of protein kinases. Trends in Pharmacological Science 10 (6): 218-220. Staruosporine can be an anticancer treatment. Staurosporine can inhibit protein kinases through the prevention of ATP binding to the kinase. This inhibition can be achieved because of the higher affinity of staurosporine for the ATP-binding site on the kinase. Staurosporine is a prototypical ATP-competitive kinase inhibitor in that it can bind to many kinases with high affinity, though with little selectivity. Staurosporine can be used to induce apoptosis. One way in which staurosporine can induce apoptosis is by activating caspase-3. 
     In another embodiment, the modulator is AraC. Ara-C (cytosine arabinoside or cytarabine) is an antimetabolic agent with the chemical name of 1β-arabinofuranosylcytosine. Its mode of action can be due to its rapid conversion into cytosine arabinoside triphosphate, which damages DNA when the cell cycle holds in the S phase (synthesis of DNA). Rapidly dividing cells, which require DNA replication for mitosis, are therefore affected by treatment with cytosine arabinoside. Cytosine arabinoside can also inhibit both DNA and RNA polymerases and nucleotide reductase enzymes needed for DNA synthesis. Cytarabine can be used in the treatment of acute myeloid leukaemia, acute lymphocytic leukaemia (ALL) and in lymphomas where it is the backbone of induction chemotherapy. 
     In another embodiment, the modulator is daunorubicin. Daunorubicin or daunomycin (daunomycin cerubidine) is a chemotherapeutic of the anthracycline family that can be given as a treatment for some types of cancer. It can be used to treat specific types of leukaemia (acute myeloid leukemia and acute lymphocytic leukemia). It was initially isolated from  Streptomyces peucetius . Daunorubicin can also used to treat neuroblastoma. Daunorubicin has been used with other chemotherapy agents to treat the blastic phase of chronic myelogenous leukemia. On binding to DNA, daunomycin can intercalate, with its daunosamine residue directed toward the minor groove. It has the highest preference for two adjacent G/C base pairs flanked on the 5′ side by an A/T base pair. Daunomycin effectively binds to every 3 base pairs and induces a local unwinding angle of 1 lo, but negligible distortion of helical conformation. 
     Gating 
     In another embodiment, a user may analyze the signaling in subpopulations based on surface markers. For example, the user could look at: “stem cell populations” by CD34+ CD38− or CD34+ CD33− expressing cells; drug transporter positive cells; i.e. FLT3 LIGAND+ cells; or multiple leukemic subclones based on CD33, CD45, HLA-DR, CD11b and analyzing signaling in each subpopulation. In another alternative embodiment, a user may analyze the data based on intracellular markers, such as transcription factors or other intracellular proteins; based on a functional assay (i.e. dye negative “side population” aka drug transporter+ cells, or fluorescent glucose uptake, or based on other fluorescent markers. In some embodiments, a gate is established after learning from a responsive subpopulation. That is, a gate is developed from one data set after finding a population that correlates with a clinical outcome. This gate can then be applied retrospectively or prospectively to other data sets. 
     In some embodiments where flow cytometry is used, prior to analyzing of data the populations of interest and the method for characterizing these populations are determined. For instance, there are at least two general ways of identifying populations for data analysis: (i) “Outside-in” comparison of Parameter sets for individual samples or subset (e.g., patients in a trial). In this more common case, cell populations are homogenous or lineage gated in such a way as to create distinct sets considered to be homogenous for targets of interest. An example of sample-level comparison would be the identification of signaling profiles in tumor cells of a patient and correlation of these profiles with non-random distribution of clinical responses. This is considered an outside-in approach because the population of interest is pre-defined prior to the mapping and comparison of its profile to other populations. (ii) “Inside-out” comparison of Parameters at the level of individual cells in a heterogeneous population. An example of this would be the signal transduction state mapping of mixed hematopoietic cells under certain conditions and subsequent comparison of computationally identified cell clusters with lineage specific markers. This could be considered an inside-out approach to single cell studies as it does not presume the existence of specific populations prior to classification. A major drawback of this approach is that it creates populations which, at least initially, require multiple transient markers to enumerate and may never be accessible with a single cell surface epitope. As a result, the biological significance of such populations can be difficult to determine. The main advantage of this unconventional approach is the unbiased tracking of cell populations without drawing potentially arbitrary distinctions between lineages or cell types. 
     Each of these techniques capitalizes on the ability of flow cytometry to deliver large amounts of multiparameter data at the single cell level. For cells associated with a condition (e.g. neoplastic or hematopoietic condition), a third “meta-level” of data exists because cells associated with a condition (e.g. cancer cells) are generally treated as a single entity and classified according to historical techniques. These techniques have included organ or tissue of origin, degree of differentiation, proliferation index, metastatic spread, and genetic or metabolic data regarding the patient. 
     In some embodiments, the present invention uses variance mapping techniques for mapping condition signaling space. These methods represent a significant advance in the study of condition biology because it enables comparison of conditions independent of a putative normal control. Traditional differential state analysis methods (e.g., DNA microarrays, subtractive Northern blotting) generally rely on the comparison of cells associated with a condition from each patient sample with a normal control, generally adjacent and theoretically untransformed tissue. Alternatively, they rely on multiple clusterings and reclusterings to group and then further stratify patient samples according to phenotype. In contrast, variance mapping of condition states compares condition samples first with themselves and then against the parent condition population. As a result, activation states with the most diversity among conditions provide the core parameters in the differential state analysis. Given a pool of diverse conditions, this technique allows a researcher to identify the molecular events that underlie differential condition pathology (e.g., cancer responses to chemotherapy), as opposed to differences between conditions and a proposed normal control. 
     In some embodiments, when variance mapping is used to profile the signaling space of patient samples, conditions whose signaling response to modulators is similar are grouped together, regardless of tissue or cell type of origin. Similarly, two conditions (e.g. two tumors) that are thought to be relatively alike based on lineage markers or tissue of origin could have vastly different abilities to interpret environmental stimuli and would be profiled in two different groups. 
     When groups of signaling profiles have been identified it is frequently useful to determine whether other factors, such as clinical responses, presence of gene mutations, and protein expression levels, are non-randomly distributed within the groups. If experiments or literature suggest such a hypothesis in an arrayed flow cytometry experiment, it can be judged with simple statistical tests, such as the Student&#39;s t-test and the X 2  test. Similarly, if two variable factors within the experiment are thought to be related, the Pearson, and/or Spearman are used to measure the degree of this relationship. 
     Examples of analysis for activatable elements are described in U.S. publication number 20060073474 entitled “Methods and compositions for detecting the activation state of multiple proteins in single cells” and U.S. publication number 20050112700 entitled “Methods and compositions for risk stratification” the content of which are incorporate here by reference. Gating methods are shown in U.S. Ser. No. 12/501,295. 
     Binding Element 
     In some embodiments, the activation level of an activatable element is determined. One embodiment makes this determination by contacting a cell from a cell population with a binding element that is specific for an activation state of the activatable element. The term “binding element” includes any molecule, e.g., peptide, nucleic acid, small organic molecule which is capable of detecting an activation state of an activatable element over another activation state of the activatable element. Binding elements and labels for binding elements are shown in U.S. Ser. Nos. 12/432,720, 12/229,476, 12/460,029, 12/730,120, 12/617,438 and 12/910,769. 
     In some embodiments, the binding element is a peptide, polypeptide, oligopeptide or a protein. The peptide, polypeptide, oligopeptide or protein may be made up of naturally occurring amino acids and peptide bonds, or synthetic peptidomimetic structures. Thus “amino acid”, or “peptide residue”, as used herein include both naturally occurring and synthetic amino acids. For example, homo-phenylalanine, citrulline and noreleucine are considered amino acids. The side chains may be in either the (R) or the (S) configuration. In some embodiments, the amino acids are in the (S) or L-configuration. If non-naturally occurring side chains are used, non-amino acid substituents may be used, for example to prevent or retard in vivo degradation. Proteins including non-naturally occurring amino acids may be synthesized or in some cases, made recombinantly; see van Hest et al., FEBS Lett 428:(1-2) 68-70 May 22, 1998 and Tang et al., Abstr. Pap Am. Chem. S218: U138 Part 2 Aug. 22, 1999, both of which are expressly incorporated by reference herein. 
     Methods described herein may be used to detect any particular activatable element in a sample that is antigenically detectable and antigenically distinguishable from other activatable element which is present in the sample. For example, activation state-specific antibodies can be used in the present methods to identify distinct signaling cascades of a subset or subpopulation of complex cell populations and the ordering of protein activation (e.g., kinase activation) in potential signaling hierarchies. Hence, in some embodiments the expression and phosphorylation of one or more polypeptides are detected and quantified using methods described herein. In some embodiments, the expression and phosphorylation of one or more polypeptides that are cellular components of a cellular pathway are detected and quantified using methods described herein. As used herein, the term “activation state-specific antibody” or “activation state antibody” or grammatical equivalents thereof, can refer to an antibody that specifically binds to a corresponding and specific antigen. The corresponding and specific antigen can be a specific form of an activatable element. The binding of the activation state-specific antibody can be indicative of a specific activation state of a specific activatable element. 
     In some embodiments, the binding element is an antibody. In some embodiment, the binding element is an activation state-specific antibody. 
     The term “antibody” includes full length antibodies and antibody fragments, and can refer to a natural antibody from any organism, an engineered antibody, or an antibody generated recombinantly for experimental, therapeutic, or other purposes as further defined below. Examples of antibody fragments, as are known in the art, such as Fab, Fab′, F(ab′)2, Fv, scFv, or other antigen-binding subsequences of antibodies, either produced by the modification of whole antibodies or those synthesized de novo using recombinant DNA technologies. The term “antibody” comprises monoclonal and polyclonal antibodies. Antibodies can be antagonists, agonists, neutralizing, inhibitory, or stimulatory. They can be humanized, glycosylated, bound to solid supports, and posses other variations. See U.S. Ser. Nos. 12/432,720, 12/229,476, 12/460,029, and 12/910,769 for more information about antibodies as binding elements. 
     Activation state specific antibodies can be used to detect kinase activity; however additional means for determining kinase activation are provided herein. For example, substrates that are specifically recognized by protein kinases and phosphorylated thereby are known. Antibodies that specifically bind to such phosphorylated substrates but do not bind to such non-phosphorylated substrates (phospho-substrate antibodies) can be used to determine the presence of activated kinase in a sample. 
     The antigenicity of an activated isoform of an activatable element can be distinguishable from the antigenicity of non-activated isoform of an activatable element or from the antigenicity of an isoform of a different activation state. In some embodiments, an activated isoform of an element possesses an epitope that is absent in a non-activated isoform of an element, or vice versa. In some embodiments, this difference is due to covalent addition of a moiety to an element, such as a phosphate moiety, or due to a structural change in an element, as through protein cleavage, or due to an otherwise induced conformational change in an element which causes the element to present the same sequence in an antigenically distinguishable way. In some embodiments, such a conformational change causes an activated isoform of an element to present at least one epitope that is not present in a non-activated isoform, or to not present at least one epitope that is presented by a non-activated isoform of the element. In some embodiments, the epitopes for the distinguishing antibodies are centered around the active site of the element, although as is known in the art, conformational changes in one area of an element may cause alterations in different areas of the element as well. 
     Many antibodies, many of which are commercially available (for example, see Cell Signaling Technology, www.cellsignal.com or Becton Dickinson, www.bd.com) have been produced which specifically bind to the phosphorylated isoform of a protein but do not specifically bind to a non-phosphorylated isoform of a protein. Many such antibodies have been produced for the study of signal transducing proteins which are reversibly phosphorylated. Particularly, many such antibodies have been produced which specifically bind to phosphorylated, activated isoforms of protein. Examples of proteins that can be analyzed with the methods described herein include, but are not limited to, kinases, HER receptors, PDGF receptors, FLT3 receptor, Kit receptor, FGF receptors, Eph receptors, Trk receptors, IGF receptors, Insulin receptor, Met receptor, Ret, VEGF receptors, TIE1, TIE2, erythropoetin receptor, thromobopoetin receptor, CD114, CD116, FAK, Jak1, Jak2, Jak3, Tyk2, Src, Lyn, Fyn, Lck, Fgr, Yes, Csk, Abl, Btk, ZAP70, Syk, IRAKs, cRaf, ARaf, BRAF, Mos, Lim kinase, ILK, Tpl, ALK, TGFβ receptors, BMP receptors, MEKKs, ASK, MLKs, DLK, PAKs, Mek 1, Mek 2, MKK3/6, MKK4/7, ASK1, Cot, NIK, Bub, Myt 1, Weel, Casein kinases, PDK1, SGK1, SGK2, SGK3, Akt1, Akt2, Akt3, p90Rsks, p70S6Kinase, Prks, PKCs, PKAs, ROCK 1, ROCK 2, Auroras, CaMKs, MNKs, AMPKs, MELK, MARKs, Chk1, Chk2, LKB-1, MAPKAPKs, Pim1, Pim2, Pim3, IKKs, Cdks, Jnks, Erks, IKKs, GSK3α, GSK3β, Cdks, CLKs, PKR, PI3-Kinase class 1, class 2, class 3, mTor, SAPK/JNK1,2,3, p38s, PKR, DNA-PK, ATM, ATR, phosphatases, Receptor protein tyrosine phosphatases (RPTPs), LAR phosphatase, CD45, Non receptor tyrosine phosphatases (NPRTPs), SHPs, MAP kinase phosphatases (MKPs), Dual Specificity phosphatases (DUSPs), CDC25 phosphatases, Low molecular weight tyrosine phosphatase, Eyes absent (EYA) tyrosine phosphatases, Slingshot phosphatases (SSH), serine phosphatases, PP2A, PP2B, PP2C, PP1, PPS, inositol phosphatases, PTEN, SHIPs, myotubularins, lipid signaling, phosphoinositide kinases, phopsholipases, prostaglandin synthases, 5-lipoxygenase, sphingosine kinases, sphingomyelinases, adaptor/scaffold proteins, Shc, Grb2, BLNK, LAT, B cell adaptor for PI3-kinase (BCAP), SLAP, Dok, KSR, MyD88, Crk, CrkL, GAD, Nck, Grb2 associated binder (GAB), Fas associated death domain (FADD), TRADD, TRAF2, RIP, T-Cell leukemia family, cytokines, IL-2, IL-4, IL-8, IL-6, interferon γ, interferon α, cytokine regulators, suppressors of cytokine signaling (SOCs), ubiquitination enzymes, Cbl, SCF ubiquitination ligase complex, APC/C, adhesion molecules, integrins, Immunoglobulin-like adhesion molecules, selectins, cadherins, catenins, focal adhesion kinase, p130CAS, cytoskeletal/contractile proteins, fodrin, actin, paxillin, myosin, myosin binding proteins, tubulin, eg5/KSP, CENPs, heterotrimeric G proteins, β-adrenergic receptors, muscarinic receptors, adenylyl cyclase receptors, small molecular weight GTPases, H-Ras, K-Ras, N-Ras, Ran, Rac, Rho, Cdc42, Arfs, RABs, RHEB, guanine nucleotide exchange factors, Vav, Tiam, Sos, Dbl, PRK, TSC1,2, GTPase activating proteins, Ras-GAP, Arf-GAPs, Rho-GAPs, caspases, Caspase 2, Caspase 3, Caspase 6, Caspase 7, Caspase 8, Caspase 9, proteins involved in apoptosis, Bcl-2, Mcl-1, Bcl-XL, Bcl-w, Bcl-B, Al, Bax, Bak, Bok, Bik, Bad, Bid, Bim, Bmf, Hrk, Noxa, Puma, IAPs, XIAP, Smac, cell cycle regulators, Cdk4, Cdk 6, Cdk 2, Cdk1, Cdk 7, Cyclin D, Cyclin E, Cyclin A, Cyclin B, Rb, p16, p14Arf, p27KIP, p21CIP, molecular chaperones, Hsp90s, Hsp70, Hsp27, metabolic enzymes, Acetyl-CoAa Carboxylase, ATP citrate lyase, nitric oxide synthase, vesicular transport proteins, caveolins, endosomal sorting complex required for transport (ESCRT) proteins, vesicular protein sorting (Vsps), hydroxylases, prolyl-hydroxylases PHD-1, 2 and 3, asparagine hydroxylase FIH transferases, isomerases, Pini prolyl isomerase, topoisomerases, deacetylases, Histone deacetylases, sirtuins, acetylases, histone acetylases, CBP/P300 family, MYST family, ATF2, methylases, DNA methyl transferases, demethylases, Histone H3K4 demethylases, H3K27, JHDM2A, UTX, tumor suppressor genes, VHL, WT-1, p53, Hdm, PTEN, proteases, ubiquitin proteases, urokinase-type plasminogen activator (uPA) and uPA receptor (uPAR) system, cathepsins, metalloproteinases, esterases, hydrolases, separase, ion channels, potassium channels, sodium channels, molecular transporters, multi-drug resistance proteins, P-Gycoprotein, nucleoside transporters, transcription factors/DNA binding proteins, Ets family transcription factors, Ets-1, Ets-2, Tel, Tel2, Elk, SMADs, Rel-A (p65-NFKB), CREB, NFAT, ATF-2, AFT, Myc, Fos, Spl, Egr-1, T-bet, β-catenin, HIFs, FOXOs, E2Fs, SRFs, TCFs, Egr-1, β-FOXO STAT1, STAT 3, STAT 4, STAT 5, STAT 6, p53, WT-1, HMGA, regulators of translation, pS6, 4EPB-1, eIF4E-binding protein, regulators of transcription, RNA polymerase, initiation factors, elongation factors. In some embodiments, the protein is S6. 
     In some embodiments, an epitope-recognizing fragment of an activation state antibody rather than the whole antibody is used. In some embodiments, the epitope-recognizing fragment is immobilized. In some embodiments, the antibody light chain that recognizes an epitope is used. A recombinant nucleic acid encoding a light chain gene product that recognizes an epitope can be used to produce such an antibody fragment by recombinant means well known in the art. 
     In alternative embodiments, aromatic amino acids of protein binding elements can be replaced with other molecules. See U.S. S. Nos. U.S. Ser. Nos. 12/432,720, 12/229,476, 12/460,029, 12/730,120, 12/617,438 and 12/910,769. 
     In some embodiments, the activation state-specific binding element is a peptide comprising a recognition structure that binds to a target structure on an activatable protein. A variety of recognition structures are well known in the art and can be made using methods known in the art, including by phage display libraries (see e.g., Gururaja et al. Chem. Biol. (2000) 7:515-27; Houimel et al., Eur. J. Immunol. (2001) 31:3535-45; Cochran et al. J. Am. Chem. Soc. (2001) 123:625-32; Houimel et al. Int. J. Cancer (2001) 92:748-55, each incorporated herein by reference). Further, fluorophores can be attached to such antibodies for use in the methods described herein. 
     A variety of recognitions structures are known in the art (e.g., Cochran et al., J. Am. Chem. Soc. (2001) 123:625-32; Boer et al., Blood (2002) 100:467-73, each expressly incorporated herein by reference)) and can be produced using methods known in the art (see e.g., Boer et al., Blood (2002) 100:467-73; Gualillo et al., Mol. Cell Endocrinol. (2002) 190:83-9, each expressly incorporated herein by reference)), including for example combinatorial chemistry methods for producing recognition structures such as polymers with affinity for a target structure on an activatable protein (see e.g., Barn et al., J. Comb. Chem. (2001) 3:534-41; Ju et al., Biotechnol. (1999) 64:232-9, each expressly incorporated herein by reference). In another embodiment, the activation state-specific antibody is a protein that only binds to an isoform of a specific activatable protein that is phosphorylated and does not bind to the isoform of this activatable protein when it is not phosphorylated or nonphosphorylated. In another embodiment the activation state-specific antibody is a protein that only binds to an isoform of an activatable protein that is intracellular and not extracellular, or vice versa. In some embodiments, the recognition structure is an anti-laminin single-chain antibody fragment (scFv) (see e.g., Sanz et al., Gene Therapy (2002) 9:1049-53; Tse et al., J. Mol. Biol. (2002) 317:85-94, each expressly incorporated herein by reference). 
     In some embodiments the binding element is a nucleic acid. The term “nucleic acid” include nucleic acid analogs, for example, phosphoramide (Beaucage et al., Tetrahedron 49(10):1925 (1993) and references therein; Letsinger, J. Org. Chem. 35:3800 (1970); Sprinzl et al., Eur. J. Biochem. 81:579 (1977); Letsinger et al., Nucl. Acids Res. 14:3487 (1986); Sawai et al, Chem. Lett. 805 (1984), Letsinger et al., J. Am. Chem. Soc. 110:4470 (1988); and Pauwels et al., Chemica Scripta 26:141 91986)), phosphorothioate (Mag et al., Nucleic Acids Res. 19:1437 (1991); and U.S. Pat. No. 5,644,048), phosphorodithioate (Briu et al., J. Am. Chem. Soc. 111:2321 (1989), O-methylphophoroamidite linkages (see Eckstein, Oligonucleotides and Analogues: A Practical Approach, Oxford University Press), and peptide nucleic acid backbones and linkages (see Egholm, J. Am. Chem. Soc. 114:1895 (1992); Meier et al., Chem. Int. Ed. Engl. 31:1008 (1992); Nielsen, Nature, 365:566 (1993); Carlsson et al., Nature 380:207 (1996), all of which are incorporated by reference). Other analog nucleic acids include those with positive backbones (Denpcy et al., Proc. Natl. Acad. Sci. USA 92:6097 (1995); non-ionic backbones (U.S. Pat. Nos. 5,386,023, 5,637,684, 5,602,240, 5,216,141 and 4,469,863; Kiedrowshi et al., Angew. Chem. Intl. Ed. English 30:423 (1991); Letsinger et al., J. Am. Chem. Soc. 110:4470 (1988); Letsinger et al., Nucleoside &amp; Nucleotide 13:1597 (1994); Chapters 2 and 3, ASC Symposium Series 580, “Carbohydrate Modifications in Antisense Research”, Ed. Y. S. Sanghui and P. Dan Cook; Mesmaeker et al., Bioorganic &amp; Medicinal Chem. Lett. 4:395 (1994); Jeffs et al. 
     Detection 
     In practicing the methods described herein, the detection of the status of the one or more activatable elements can be carried out by a person, such as a technician in the laboratory. Alternatively, the detection of the status of the one or more activatable elements can be carried out using automated systems. In either case, the detection of the status of the one or more activatable elements for use according to the methods described herein can be performed according to standard techniques and protocols well-established in the art. 
     One or more activatable elements can be detected and/or quantified by any method that detects and/or quantitates the presence of the activatable element of interest. Such methods may include flow cytometry, mass cytometry, radioimmunoassay (RIA) or enzyme linked immunoabsorbance assay (ELISA), immunohistochemistry, immunofluorescent histochemistry with or without confocal microscopy, reversed phase assays, homogeneous enzyme immunoassays, and related non-enzymatic techniques, Western, Northern, and Southern blots, PCR, nucleic acid sequencing, whole cell staining, immunoelectronmicroscopy, nucleic acid amplification, gene array, protein array, mass spectrometry, patch clamp, 2-dimensional gel electrophoresis, differential display gel electrophoresis, microsphere-based multiplex protein assays, label-free cellular assays and flow cytometry, etc. U.S. Pat. No. 4,568,649 describes ligand detection systems, which employ scintillation counting. These techniques are particularly useful for modified protein parameters. Cell readouts for proteins and other cell determinants can be obtained using fluorescent or otherwise tagged reporter molecules. Flow cytometry methods are useful for measuring intracellular parameters. 
     In some embodiments, the present invention provides methods for determining an activatable element&#39;s activation profile for a single cell. The methods may comprise analyzing cells by flow cytometry on the basis of the activation level of at least two activatable elements. Binding elements (e.g. activation state-specific antibodies) are used to analyze cells on the basis of activatable element activation level, and can be detected as described below. Alternatively, non-binding elements systems as described above can be used in any system described herein. 
     Detection of cell signaling states may be accomplished using binding elements and labels. Cell signaling states may be detected by a variety of methods known in the art. They generally involve a binding element, such as an antibody, and a label, such as a fluorochrome to form a detection element. Detection elements do not need to have both of the above agents, but can be one unit that possesses both qualities. These and other methods, instruments and devices are well described in U.S. Pat. Nos. 7,381,535 and 7,393,656 and U.S. Ser. Nos. 10/193,462; 11/655,785; 11/655,789; 11/655,821; 11/338,957, 657, 12/432,720, 12/229,476, 12/460,029, and 12/910,769 (as well as the applications listed above) which are all incorporated by reference in their entireties. 
     In one embodiment, it is advantageous to increase the signal to noise ratio by contacting the cells with the antibody and label for a time greater than 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 24 or up to 48 or more hours. 
     When using fluorescent labeled components in the methods and compositions described herein, it will be recognized that different types of fluorescent monitoring systems, e.g., cytometric measurement device systems, can be used. In some embodiments, flow cytometric systems are used or systems dedicated to high throughput screening, e.g. 96 well or greater microtiter plates. Methods of performing assays on fluorescent materials are well known in the art and are described in, e.g., Lakowicz, J. R., Principles of Fluorescence Spectroscopy, New York: Plenum Press (1983); Herman, B., Resonance energy transfer microscopy, in: Fluorescence Microscopy of Living Cells in Culture, Part B, Methods in Cell Biology, vol. 30, ed. Taylor, D. L. &amp; Wang, Y.-L., San Diego: Academic Press (1989), pp. 219-243; Turro, N. J., Modern Molecular Photochemistry, Menlo Park: Benjamin/Cummings Publishing Col, Inc. (1978), pp. 296-361. Commercial instruments are available through Becton Dickinson and Beckman Coulter, among others. 
     Fluorescence in a sample can be measured using a fluorimeter. In general, excitation radiation, from an excitation source having a first wavelength, passes through excitation optics. The excitation optics deliver the excitation radiation to excite the sample. In response, fluorescent proteins in the sample emit radiation that has a wavelength that is different from the excitation wavelength. Collection optics then collect the emission from the sample. The device can include a temperature controller to maintain the sample at a specific temperature while it is being scanned. According to one embodiment, a multi-axis translation stage moves a microtiter plate holding a plurality of samples in order to position different wells to be exposed. The multi-axis translation stage, temperature controller, auto-focusing feature, and electronics associated with imaging and data collection can be managed by an appropriately programmed digital computer. The computer also can transform the data collected during the assay into another format for presentation. In general, known robotic systems and components can be used. 
     Other methods of detecting fluorescence may also be used, e.g., Quantum dot methods (see, e.g., Goldman et al., J. Am. Chem. Soc. (2002) 124:6378-82; Pathak et al. J. Am. Chem. Soc. (2001) 123:4103-4; and Remade et al., Proc. Natl. Sci. USA (2000) 18:553-8, each expressly incorporated herein by reference) as well as confocal microscopy. In general, flow cytometry involves the passage of individual cells through the path of a laser beam. The scattering the beam and excitation of any fluorescent molecules attached to, or found within, the cell is detected by photomultiplier tubes to create a readable output, e.g. size, granularity, or fluorescent intensity. 
     In some embodiments, the activation level of an activatable element is measured using Inductively Coupled Plasma Mass Spectrometer (ICP-MS). A binding element that has been labeled with a specific element binds to the activatable. When the cell is introduced into the ICP, it is atomized and ionized. The elemental composition of the cell, including the labeled binding element that is bound to the activatable element, is measured. The presence and intensity of the signals corresponding to the labels on the binding element indicates the level of the activatable element on that cell (Tanner et al. Spectrochimica Acta Part B: Atomic Spectroscopy, 2007 March; 62(3): 188-195.). 
     The detecting, sorting, or isolating step of the methods of the present invention can entail fluorescence-activated cell sorting (FACS) techniques, where FACS is used to select cells from the population containing a particular surface marker, or the selection step can entail the use of magnetically responsive particles as retrievable supports for target cell capture and/or background removal. A variety of FACS systems are known in the art and can be used in the methods described herein (see e.g., WO99/54494, filed Apr. 16, 1999; U.S. Ser. No. 20010006787, filed Jul. 5, 2001, each expressly incorporated herein by reference). 
     In some embodiments, a FACS cell sorter (e.g. a FACSVantage™ Cell Sorter, Becton Dickinson Immunocytometry Systems, San Jose, Calif.) is used to sort and collect cells based on their activation profile (positive cells) in the presence or absence of an increase in activation level in an activatable element in response to a modulator. Other flow cytometers that are commercially available include the LSR II and the Canto II both available from Becton Dickinson others are available from Attune Acoustic Cytometer (Life Technologies, Carlsbad, Calif.) and the CyTOF (DVS Sciences, Sunnyvale, Calif.). See Shapiro, Howard M., Practical Flow Cytometry, 4th Ed., John Wiley &amp; Sons, Inc., 2003 for additional information on flow cytometers. 
     In some embodiments, the cells are first contacted with fluorescent-labeled activation state-specific binding elements (e.g. antibodies) directed against specific activation state of specific activatable elements. In such an embodiment, the amount of bound binding element on each cell can be measured by passing droplets containing the cells through the cell sorter. By imparting an electromagnetic charge to droplets containing the positive cells, the cells can be separated from other cells. The positively selected cells can then be harvested in sterile collection vessels. These cell-sorting procedures are described in detail, for example, in the FACSVantage™ Manual, with particular reference to sections 3-11 to 3-28 and 10-1 to 10-17, which is hereby incorporated by reference in its entirety. See the patents, applications and articles referred to, and incorporated above for detection systems. 
     Fluorescent compounds such as Daunorubicin and Enzastaurin are problematic for flow cytometry based biological assays due to their broad fluorescence emission spectra. These compounds get trapped inside cells after fixation with agents like paraformaldehyde, and are excited by one or more of the lasers found on flow cytometers. The fluorescence emission of these compounds is often detected in multiple PMT detectors which complicates their use in multiparametric flow cytometry. A way to get around this problem is to compensate out the fluorescence emission of the compound from the PMT detectors used to measure the relevant biological markers. This is achieved using a PMT detector with a bandpass filter near the emission maximum of the fluorescent compound, and cells incubated with the compound as the compensation control when calculating a compensation matrix. The cells incubated with the fluorescent compound are fixed with paraformaldehyde, then washed and permeabilized with 100% methanol. The methanol is washed out and the cells are mixed with unlabeled fixed/permed cells to yield a compensation control consisting of a mixture of fluorescent and negative cell populations. 
     In another embodiment, positive cells can be sorted using magnetic separation of cells based on the presence of an isoform of an activatable element. In such separation techniques, cells to be positively selected are first contacted with specific binding element (e.g., an antibody or reagent that binds an isoform of an activatable element). The cells are then contacted with retrievable particles (e.g., magnetically responsive particles) that are coupled with a reagent that binds the specific element. The cell-binding element-particle complex can then be physically separated from non-positive or non-labeled cells, for example, using a magnetic field. When using magnetically responsive particles, the positive or labeled cells can be retained in a container using a magnetic field while the negative cells are removed. These and similar separation procedures are described, for example, in the Baxter Immunotherapy Isolex manual which is hereby incorporated in its entirety. 
     In some embodiments, methods for the determination of a receptor element activation state profile for a single cell are provided. The methods comprise providing a population of cells and analyze the population of cells by flow cytometry. Preferably, cells are analyzed on the basis of the activation level of at least two activatable elements. In some embodiments, a multiplicity of activatable element activation-state antibodies is used to simultaneously determine the activation level of a multiplicity of elements. 
     In some embodiments, cell analysis by flow cytometry on the basis of the activation level of at least two elements is combined with a determination of other flow cytometry readable outputs, such as the presence of surface markers, granularity and cell size to provide a correlation between the activation level of a multiplicity of elements and other cell qualities measurable by flow cytometry for single cells. 
     As will be appreciated, methods described herein also provide for the ordering of element clustering events in signal transduction. Particularly, the methods described herein allow the artisan to construct an element clustering and activation hierarchy based on the correlation of levels of clustering and activation of a multiplicity of elements within single cells. Ordering can be accomplished by comparing the activation level of a cell or cell population with a control at a single time point, or by comparing cells at multiple time points to observe subpopulations arising out of the others. 
     The methods described herein provide a valuable method of determining the presence of cellular subsets within cellular populations. Ideally, signal transduction pathways are evaluated in homogeneous cell populations to ensure that variances in signaling between cells do not qualitatively nor quantitatively mask signal transduction events and alterations therein. As the ultimate homogeneous system is the single cell, the present invention allows the individual evaluation of cells to allow true differences to be identified in a significant way. 
     Thus, the invention provides methods of distinguishing cellular subsets within a larger cellular population. As outlined herein, these cellular subsets often exhibit altered biological characteristics (e.g. activation levels, altered response to modulators) as compared to other subsets within the population. For example, as outlined herein, the methods described herein allow the identification of subsets of cells from a population such as primary cell populations, e.g. peripheral blood mononuclear cells that exhibit altered responses (e.g. response associated with presence of a condition) as compared to other subsets. In addition, this type of evaluation distinguishes between different activation states, altered responses to modulators, cell lineages, cell differentiation states, etc. 
     As will be appreciated, these methods provide for the identification of distinct signaling cascades for both artificial and stimulatory conditions in complex cell populations, such a peripheral blood mononuclear cells, or naive and memory lymphocytes. 
     When necessary cells are dispersed into a single cell suspension, e.g. by enzymatic digestion with a suitable protease, e.g. collagenase, dispase, etc; and the like. An appropriate solution is used for dispersion or suspension. Such solution will generally be a balanced salt solution, e.g. normal saline, PBS, Hanks balanced salt solution, etc., conveniently supplemented with fetal calf serum or other naturally occurring factors, in conjunction with an acceptable buffer at low concentration, generally from 5-25 mM. Convenient buffers include HEPES 1 phosphate buffers, lactate buffers, etc. The cells may be fixed, e.g. with 3% paraformaldehyde, and are usually permeabilized, e.g. with ice cold methanol; HEPES-buffered PBS containing 0.1% saponin, 3% BSA; covering for 2 min in acetone at −200° C.; and the like as known in the art and according to the methods described herein. 
     In one embodiment, a methanol dispensing instrument is used to permeabilize the cells. It is important to ensure that the correct volume of methanol is being dispensed into the wells, otherwise the labeling reagents will not have access to their targets. To ensure that the appropriate amount of methanol is dispensed, the dispenser is charged beforehand with methanol or is charged with methanol either manually or automatically. 
     The methanol dispensing heads in the instrument can be stored with methanol or air in the dispensing channels. Air can be drawn through the dispensing heads, then an alcohol solution and then stored air dried or with methanol. Upon reuse of the instrument or any restart of the process, the dispensing heads are recharged with methanol. A bleeder valve can be used to fill up the head with the correct amount of methanol. In one embodiment, the instrument dispenser is charged by flushing several methanol washes through the dispenser head. In one embodiment, 2, 3, 4, 5, 6, washes are used to fill and clean the head. 
     In some embodiments, the present invention uses platforms for multi-well plates, multi-tubes, holders, cartridges, minitubes, deep-well plates, microfuge tubes, cryovials, square well plates, filters, chips, optic fibers, beads, and other solid-phase matrices or platform with various volumes are accommodated on an upgradable modular platform for additional capacity. This modular platform includes a variable speed orbital shaker, and multi-position work decks for source samples, sample and reagent dilution, assay plates, sample and reagent reservoirs, pipette tips, and an active wash station. One embodiment uses microtiter plates and reference will be made to this embodiment as a representative of those articles that can contain samples to be analyzed. 
     In some embodiments, one or more cells are contained in a well of a 96 well plate or other commercially available multiwell plate. In an alternate embodiment, the reaction mixture or cells are in a cytometric measurement device. Other multiwell plates useful in the present invention include, but are not limited to 384 well plates and 1536 well plates. Still other vessels for containing the reaction mixture or cells and useful for the present invention will be apparent to the skilled artisan. Methods to automate the analysis are shown in U.S. Ser. No. 12/606,869 which is hereby incorporated by reference in its entirety. 
     The addition of the components of the assay for detecting the activation level or activity of an activatable element, or modulation of such activation level or activity, may be sequential or in a predetermined order or grouping under conditions appropriate for the activity that is assayed for. Such conditions are described here and known in the art. Moreover, further guidance is provided below (see, e.g., in the Examples). 
     In some embodiments, the activation level of an activatable element is measured using Inductively Coupled Plasma Mass Spectrometer (ICP-MS). A binding element that has been labeled with a specific element binds to the activatable. When the cell is introduced into the ICP, it is atomized and ionized. The elemental composition of the cell, including the labeled binding element that is bound to the activatable element, is measured. The presence and intensity of the signals corresponding to the labels on the binding element indicates the level of the activatable element on that cell (Tanner et al. Spectrochimica Acta Part B: Atomic Spectroscopy, 2007 March; 62(3): 188-195.). 
     As will be appreciated by one of skill in the art, the instant methods and compositions find use in a variety of other assay formats in addition to flow cytometry analysis. For example, DNA microarrays are commercially available through a variety of sources (Affymetrix, Santa Clara Calif.) or they can be custom made in the lab using arrayers which are also know (Perkin Elmer). In addition, protein chips and methods for synthesis are known. These methods and materials may be adapted for the purpose of affixing activation state binding elements to a chip in a prefigured array. In some embodiments, such a chip comprises a multiplicity of element activation state binding elements, and is used to determine an element activation state profile for elements present on the surface of a cell. 
     In some embodiments, a chip comprises a multiplicity of the “second set binding elements,” in this case generally unlabeled. Such a chip is contacted with sample, preferably cell extract, and a second multiplicity of binding elements comprising element activation state specific binding elements is used in the sandwich assay to simultaneously determine the presence of a multiplicity of activated elements in sample. Preferably, each of the multiplicity of activation state-specific binding elements is uniquely labeled to facilitate detection. 
     In some embodiments confocal microscopy can be used to detect activation profiles for individual cells. Confocal microscopy relies on the serial collection of light from spatially filtered individual specimen points, which is then electronically processed to render a magnified image of the specimen. The signal processing involved confocal microscopy has the additional capability of detecting labeled binding elements within single cells, accordingly in this embodiment the cells can be labeled with one or more binding elements. In some embodiments the binding elements used in connection with confocal microscopy are antibodies conjugated to fluorescent labels, however other binding elements, such as other proteins or nucleic acids are also possible. 
     In some embodiments, the methods and compositions of the instant invention can be used in conjunction with an “In-Cell Western Assay.” In such an assay, cells are initially grown in standard tissue culture flasks using standard tissue culture techniques. Once grown to optimum confluency, the growth media is removed and cells are washed and trypsinized. The cells can then be counted and volumes sufficient to transfer the appropriate number of cells are aliquoted into microwell plates (e.g., Nunc™ 96 Microwell™ plates). The individual wells are then grown to optimum confluency in complete media whereupon the media is replaced with serum-free media. At this point controls are untouched, but experimental wells are incubated with a modulator, e.g. EGF. After incubation with the modulator cells are fixed and stained with labeled antibodies to the activation elements being investigated. Once the cells are labeled, the plates can be scanned using an imager such as the Odyssey Imager (LiCor, Lincoln Nebr.) using techniques described in the Odyssey Operator&#39;s Manual v1.2, which is hereby incorporated in its entirety. Data obtained by scanning of the multiwell plate can be analyzed and activation profiles determined as described below. 
     In some embodiments, the detecting is by high pressure liquid chromatography (HPLC), for example, reverse phase HPLC, and in a further aspect, the detecting is by mass spectrometry. 
     These instruments can fit in a sterile laminar flow or fume hood, or are enclosed, self-contained systems, for cell culture growth and transformation in multi-well plates or tubes and for hazardous operations. The living cells may be grown under controlled growth conditions, with controls for temperature, humidity, and gas for time series of the live cell assays. Automated transformation of cells and automated colony pickers may facilitate rapid screening of desired cells. 
     Flow cytometry or capillary electrophoresis formats can be used for individual capture of magnetic and other beads, particles, cells, and organisms. 
     Flexible hardware and software allow instrument adaptability for multiple applications. The software program modules allow creation, modification, and running of methods. The system diagnostic modules allow instrument alignment, correct connections, and motor operations. Customized tools, labware, and liquid, particle, cell and organism transfer patterns allow different applications to be performed. Databases allow method and parameter storage. Robotic and computer interfaces allow communication between instruments. 
     In some embodiments, the methods described herein include the use of liquid handling components. The liquid handling systems can include robotic systems comprising any number of components. In addition, any or all of the steps outlined herein may be automated; thus, for example, the systems may be completely or partially automated. See U.S. Ser. Nos. 12/606,869 and 12/432,239. 
     As will be appreciated by those in the art, there are a wide variety of components which can be used, including, but not limited to, one or more robotic arms; plate handlers for the positioning of microplates; automated lid or cap handlers to remove and replace lids for wells on non-cross contamination plates; tip assemblies for sample distribution with disposable tips; washable tip assemblies for sample distribution; 96 well loading blocks; cooled reagent racks; microtiter plate pipette positions (optionally cooled); stacking towers for plates and tips; and computer systems. 
     Fully robotic or microfluidic systems include automated liquid-, particle-, cell- and organism-handling including high throughput pipetting to perform all steps of screening applications. This includes liquid, particle, cell, and organism manipulations such as aspiration, dispensing, mixing, diluting, washing, accurate volumetric transfers; retrieving, and discarding of pipet tips; and repetitive pipetting of identical volumes for multiple deliveries from a single sample aspiration. These manipulations are cross-contamination-free liquid, particle, cell, and organism transfers. This instrument performs automated replication of microplate samples to filters, membranes, and/or daughter plates, high-density transfers, full-plate serial dilutions, and high capacity operation. 
     In some embodiments, chemically derivatized particles, plates, cartridges, tubes, magnetic particles, or other solid phase matrix with specificity to the assay components are used. The binding surfaces of microplates, tubes or any solid phase matrices include non-polar surfaces, highly polar surfaces, modified dextran coating to promote covalent binding, antibody coating, affinity media to bind fusion proteins or peptides, surface-fixed proteins such as recombinant protein A or G, nucleotide resins or coatings, and other affinity matrix are useful in this invention. 
     In some embodiments, platforms for multi-well plates, multi-tubes, holders, cartridges, minitubes, deep-well plates, microfuge tubes, cryovials, square well plates, filters, chips, optic fibers, beads, and other solid-phase matrices or platform with various volumes are accommodated on an upgradable modular platform for additional capacity. This modular platform includes a variable speed orbital shaker, and multi-position work decks for source samples, sample and reagent dilution, assay plates, sample and reagent reservoirs, pipette tips, and an active wash station. In some embodiments, the methods described herein include the use of a plate reader. 
     In some embodiments, thermocycler and thermoregulating systems are used for stabilizing the temperature of heat exchangers such as controlled blocks or platforms to provide accurate temperature control of incubating samples from 0° C. to 100° C. 
     In some embodiments, interchangeable pipet heads (single or multi-channel) with single or multiple magnetic probes, affinity probes, or pipetters robotically manipulate the liquid, particles, cells, and organisms. Multi-well or multi-tube magnetic separators or platforms manipulate liquid, particles, cells, and organisms in single or multiple sample formats. 
     In some embodiments, the instrumentation will include a detector, which can be a wide variety of different detectors, depending on the labels and assay. In some embodiments, useful detectors include a microscope(s) with multiple channels of fluorescence; plate readers to provide fluorescent, ultraviolet and visible spectrophotometric detection with single and dual wavelength endpoint and kinetics capability, fluorescence resonance energy transfer (FRET), luminescence, quenching, two-photon excitation, and intensity redistribution; CCD cameras to capture and transform data and images into quantifiable formats; and a computer workstation. 
     In some embodiments, the robotic apparatus includes a central processing unit which communicates with a memory and a set of input/output devices (e.g., keyboard, mouse, monitor, printer, etc.) through a bus. Again, as outlined below, this may be in addition to or in place of the CPU for the multiplexing devices described herein. The general interaction between a central processing unit, a memory, input/output devices, and a bus is known in the art. Thus, a variety of different procedures, depending on the experiments to be run, are stored in the CPU memory. 
     These robotic fluid handling systems can utilize any number of different reagents, including buffers, reagents, samples, washes, assay components such as label probes, etc. See U.S. Ser. No. 12/606,869 for automated systems. 
     Any of the steps above can be performed by a computer program product that comprises a computer executable logic that is recorded on a computer readable medium. For example, the computer program can execute some or all of the following functions: (i) exposing reference population of cells to one or more modulators, (ii) exposing reference population of cells to one or more binding elements, (iii) detecting the activation levels of one or more activatable elements, (iv) characterizing one or more cellular pathways and/or, (v) classifying one or more cells into one or more classes based on the activation level (vi) determining cell health status of a cell, (vii) determining the percentage of viable cells in a sample; (viii) determining the percentage of healthy cells in a sample; (ix) determining a cell signaling profile; (x) adjusting a cell signaling profile based on the percentage of healthy cells in a sample; (xi) adjusting a cell signaling profile for an individual cell based on the health of the cell; (xii) excluding or including a cell or population of cells in a cell signaling analysis based on the health of the cell or population of cells; (xiii) assaying for one or more cell health markers; and/or (xiv) assaying for one or more apoptosis and/or necrosis markers. 
     The computer executable logic can work in any computer that may be any of a variety of types of general-purpose computers such as a personal computer, network server, workstation, or other computer platform now or later developed. In some embodiments, a computer program product is described comprising a computer usable medium having the computer executable logic (computer software program, including program code) stored therein. The computer executable logic can be executed by a processor, causing the processor to perform functions described herein. In other embodiments, some functions are implemented primarily in hardware using, for example, a hardware state machine. Implementation of the hardware state machine so as to perform the functions described herein will be apparent to those skilled in the relevant arts. 
     The program can provide a method of determining the status of an individual by accessing data that reflects the activation level of one or more activatable elements in the reference population of cells. 
     Analysis 
     Advances in flow cytometry have enabled the individual cell enumeration of up to thirteen simultaneous parameters (De Rosa et al., 2001) and are moving towards the study of genomic and proteomic data subsets (Krutzik and Nolan, 2003; Perez and Nolan, 2002). Likewise, advances in other techniques (e.g. microarrays) allow for the identification of multiple activatable elements. As the number of parameters, epitopes, and samples have increased, the complexity of experiments and the challenges of data analysis have grown rapidly. An additional layer of data complexity has been added by the development of stimulation panels which enable the study of activatable elements under a growing set of experimental conditions. See Krutzik et al, Nature Chemical Biology February 2008. Methods for the analysis of multiple parameters are well known in the art. See U.S. Ser. Nos. 11/338,957, 12/910,769, 12/293,081, 12/538,643, 12/501,274 12/606,869 and PCT/2011/48332 for more information on analysis. See U.S. Ser. No. 12/501,295 for gating analysis. 
     In preparing a classifier for an end result, like a disease prediction, the fluorescent intensity raw data from the detector, such as a flow cytometer, is subject to processing using metrics outlined below. After treatment with the metrics, the data is fed to a model, such as machine learning, data mining, classification, or regression to provide a model for an outcome. There is also a selection of models to produce an outcome, which can be a prediction or a prognosis. 
     The data can also be processed by using characteristics of cell health and cell maturity. Information on how to use cell health to analyze cells is shown in U.S. Ser. No. 61/436,534 and PCT/US2011/01565 which are incorporated by reference in their entireties. Restricting the analysis to cells that are not in active apoptosis can provide a more useful answer in the present assay. For example, in one embodiment, a method is provided to analyze cells comprising obtaining cells, determining if the cell is undergoing apoptosis and then excluding cells from a final analysis that are undergoing apoptosis. One way to determine if a cell is undergoing apoptosis is by measuring the intracellular level of one or more activatable elements related to cell health such as cleaved PARP, MCL-1, or other compounds whose activation state or activation level correlate to a level of apoptosis within single cells. 
     Indicators for cell health can include molecules and activatable elements within molecules associated with apoptosis, necrosis, and/or autophagy, including but not limited to caspases, caspase cleavage products such as dye substrates, cleaved PARP, cleaved cytokeratin 18, cleaved caspase, cleaved caspase 3, cytochrome C, apoptosis inducing factor (AIF), Inhibitor of Apoptosis (IAP) family members, as well as other molecules such as Bcl-2 family members including anti-apoptotic proteins (MCL-1, BCL-2, BCL-XL), BH3-only apoptotic sensitizers (PUMA, NOXA, Bim, Bad), and pro-apoptotic proteins (Bad, Bax) (see below), p53, c-myc proto-oncogene, APO-1/Fas/CD95, growth stimulating genes, or tumor suppressor genes, mitochondrial membrane dyes, Annexin-V, 7-AAD, Amine Aqua, trypan blue, propidium iodide or other viability dyes. 
     Another general method for analyzing cells takes into account the maturity level of the cells. In one embodiment, cells that are immature (blasts) are included in the analysis and mature cells are not included. In another embodiment, the analysis can include all the patient&#39;s cells if they go above a certain threshold for the entire sample, for example, a call will be made on the basis of the entire sample. For example, samples having greater than 50, 60, 65, 70, 75, 80, 85, 90, or 95% immature cells can be classified as immature as a whole. In another embodiment, only those specific cells which are classified as immature are included in the analysis, irrespective of the total number of immature cells, for example, only those cells that are classified as immature will be part of the analysis for each sample. Or, a combination of the two methods could be employed, such as the counting of individual immature cells for samples that exceed a threshold related to cell maturity. 
     Cells may be classified as mature or immature manually or automatically. Methods for determining maturity are shown in Stelzer and Goodpasture, Immunophenotyping, 2000 Wiley-Liss Inc. which is incorporated by reference in its entirety. See also JOHN M. BENNETT, M.D., et al.,  Ann Intern Med.  1 Oct. 1985; 103(4):620-625. 
     In one embodiment, maturity may be determined by surface marker expression which can be applied to individual cells or at the sample level. The FAB system may also be used and applied to samples as a whole. For example, in one embodiment, samples as a whole are classified in the FAB system as M4, M5, or M7 are mature. In one embodiment, the cells may be analyzed by a variety of methods and markers, such as side scatter (SSC), CD11b, CD117, CD45 and CD34. Generally, higher side scatter, and populations of CD45 or CD11b cells will indicate mature cells and generally lower populations of CD34 and CD117 will indicate mature cells. Immature populations are classified in the FAB system as M0, M1, M2 and M6. Generally, lower side scatter and populations of CD45 or CD11b cells will indicate immature cells and generally higher populations of CD34 and CD117 will indicate immature cells. Also, peripheral blood (PB) should have more mature cells than bone marrow (BM) samples. In some embodiments, analysis of the numbers or percentages of cells that can be classified as immature or mature will be necessary. 
     In one embodiment, the use of the cell maturity analysis is combined with the analysis of cell health, in which immature blasts that are not apoptosing, are used in the analysis. In one embodiment, this method is used to model relapse, one endpoint is a complete continuous response with duration of ≧1 year (CCR1) another is survival. 
     In one embodiment, cells are classified as mature or immature and then the immature cells are analyzed using a classifier. In another embodiment, the sample is classified as mature or immature and then the immature samples are analyzed using a classifier. See example 19. 
     The metrics that are employed can relate to absolute cell counts, fluorescent intensity, frequencies of cellular populations (univariate and bivariate), relative fluorescence readouts (such as signal above background, etc.), and measurements describing relative shifts in cellular populations. In one embodiment, raw intensity data is corrected for variances in the instrument. Then the biological effect can be measured, such as measuring how much signaling is going on using the basal, fold, total and delta metrics. Also, a user can look at the number of cells that show signaling using the Mann Whitney model below. 
     In some embodiments where flow cytometry is used, flow cytometry experiments are performed and the results are expressed as fold changes using graphical tools and analyses, including, but not limited to a heat map or a histogram to facilitate evaluation. One common way of comparing changes in a set of flow cytometry samples is to overlay histograms of one parameter on the same plot. Flow cytometry experiments ideally include a reference sample against which experimental samples are compared. Reference samples can include normal and/or cells associated with a condition (e.g. tumor cells). See also U.S. Ser. No. 12/501,295 for visualization tools. 
     The patients are stratified based on nodes that inform the clinical question using a variety of metrics. To stratify the patients between those patients with No Response (NR) versus a Complete Response (CR), a prioritization of the nodes can be made according to statistical significance (such as p-value from a t-test or Wilcoxon test or area under the receiver operator characteristic (ROC) curve) or their biological relevance. See  FIGS. 2A-2B , and the methods described herein for methods for analyzing the cell signaling pathway data. For example,  FIGS. 2A-2B  show four methods to analyze data, such as from AML patients. Other characteristics such as expression markers may also be used. For example the fold over isotype can be used (e.g., log 2(MFIstain)−Log 2(MFIisotype)) or % positive above Isotype. 
       FIGS. 2A-2B  show the use of four metrics used to analyze data from cells that may be subject to a disease, such as AML. For example, the “basal” metric is calculated by measuring the autofluorescence of a cell that has not been stimulated with a modulator or stained with a labeled antibody. The “total phospho” metric is calculated by measuring the autofluorescence of a cell that has been stimulated with a modulator and stained with a labeled antibody. The “fold change” metric is the measurement of the total phospho metric divided by the basal metric. The quadrant frequency metric is the frequency of cells in each quadrant of the contour plot 
     A user may also analyze multimodal distributions to separate cell populations. In some embodiments, metrics can be used for analyzing bimodal and spread distribution. In some embodiments, a Mann-Whitney U Metric is used. 
     In some embodiments, metrics that calculate the percent of positive above unstained and metrics that calculate MFI of positive over untreated stained can be used. 
     A user can create other metrics for measuring the negative signal. For example, a user may analyze a “gated unstained” or ungated unstained autofluorescence population as the negative signal for calculations such as “basal” and “total”. This is a population that has been stained with surface markers such as CD33 and CD45 to gate the desired population, but is unstained for the fluorescent parameters to be quantitatively evaluated for node determination. However, every antibody has some degree of nonspecific association or “stickyness” which is not taken into account by just comparing fluorescent antibody binding to the autofluorescence. To obtain a more accurate “negative signal”, the user may stain cells with isotype-matched control antibodies. In addition to the normal fluorescent antibodies, in one embodiment, (phospho) or non phosphopeptides which the antibodies should recognize will take away the antibody&#39;s epitope specific signal by blocking its antigen binding site allowing this “bound” antibody to be used for evaluation of non-specific binding. In another embodiment, a user may block with unlabeled antibodies. This method uses the same antibody clones of interest, but uses a version that lacks the conjugated fluorophore. The goal is to use an excess of unlabeled antibody with the labeled version. In another embodiment, a user may block other high protein concentration solutions including, but not limited to fetal bovine serum, and normal serum of the species in which the antibodies were made, i.e. using normal mouse serum in a stain with mouse antibodies. (It is preferred to work with primary conjugated antibodies and not with stains requiring secondary antibodies because the secondary antibody will recognize the blocking serum). In another embodiment, a user may treat fixed cells with phosphatases to enzymatically remove phosphates, then stain. 
     In alternative embodiments, there are other ways of analyzing data, such as third color analysis (3D plots), which can be similar to Cytobank 2D, plus third D in color. 
     There are different ways to compare the distribution of X versus the distribution of Y. Examples are described below, such as Mann Whitney, U U , fold change, and percent positive. There are also different biological processes to measure using the above metrics, such as modulated to unmodulated states, basal to autofluorescence, different cell types such as leukemic cell to lymphocytes, and mature as compared to immature cells. 
     One embodiment of the present invention is software to examine the correlations among phosphorylation or expression levels of pairs of proteins in response to stimulus or modulation. The software examines all pairs of proteins for which phosphorylation and/or expression was measured in an experiment. The Total phosho metric (sometimes called “FoldAF”) is used to represent the phosphorylation or expression data for each protein; this data is used either on linear scale or log 2 scale. See  FIGS. 2A-2B , metric 3 for Total Phospho. 
     For each protein pair under each experimental condition (unstimulated, stimulated, or treated with drug/modulator), the Pearson correlation coefficient and linear regression line fit are computed. The Pearson correlation coefficients for samples representing responding and non-responding patients are calculated separately for each group and compared to the unperturbed (unstimulated) data. The following additional metrics are derived:
         1. Delta CRNR unstim: the difference between Pearson correlation coefficients for each protein pair for the responding patients and for the non-responding patients in the basal or unstimulated state.   2. Delta CRNR stim: the difference between Pearson correlation coefficients for each protein pair for the responding patients and for the non-responding patients in the stimulated or treated state.   3. DeltaDelta CRNR: the difference between Delta CRNRstim and Delta CRNRunstim.       

     The correlation coefficients, line fit parameters (R, p-value, and slope), and the three derived parameters described above are computed for each protein-protein pair. Protein-protein pairs are identified for closer analysis by the following criteria:
         1. Large shifts in correlations within patient classes as denoted by large positive or negative values (top and bottom quartile or 10 th  and 90 th  percentile) of the DeltaDelta CRNR parameter.   2. Large positive or negative (top and bottom quartile or 10 th  and 90 th  percentile) Pearson correlation for at least one patient group in either unstimulated or stimulated/treated condition.   3. Significant line fit (p-value &lt;=0.05 for linear regression) for at least one patient group in either unstimulated or stimulated/treated condition.       

     All pair data is plotted as a scatter plot with axes representing phosphorylation or expression level of a protein. Data for each sample (or patient) is plotted with color indicating whether the sample represents a responder (generally blue) or non-responder (generally red). Further line fits for responders, non-responders and all data are also represented on this graph, with significant line fits (p-value &lt;=0.05 in linear regression) represented by solid lines and other fits represented by dashed line, enabling rapid visual identification of significant fits. Each graph is annotated with the Pearson correlation coefficient and linear regression parameters for the individual classes and for the data as a whole. The resulting plots are saved in PNG format to a single directory for browsing using Picassa. Other visualization software can also be used. 
     In some embodiments a Mann Whitney statistical model is used for describing relative shifts in cellular populations. A Mann Whitney U test or Mann Whitney Wilcoxon (MWW) test is a non parametric statistical hypothesis test for assessing whether two independent samples of observations have equally large values. See Wikipedia at http(colon)(slashslash)en.wikipedia.org(slash)wiki/Mann % E2%80%93WhitneyU. The U metric may be more reproducible in some situations than Fold Change in some applications. 
     One example metric is U u . The U u  is a measure of the proportion of cells that have an increase (or decrease) in protein levels upon modulation from the basal state. It is computed by dividing the scaled Mann-Whitney U statistic (http(colonslashslash)en.wikipedia.org(slash)wiki/Mann % E2%80%93Whitney_U) by the number of cells in the basal and the modulated populations. The cells in the two populations are ranked by the intensity values, only these ranks are then used to compute the statistic. As a result the metric is less sensitive to the absolute intensity values and depends only on relative shift between the two populations. The metric is bound between 0.0 and 1.0. A value of 0.5 would imply no shift in protein levels from the basal state, a value greater than 0.5 would imply an induction of signaling (i.e. increase in protein levels) and value less than 0.5 would imply an inhibition of signaling (i.e. decrease in protein levels). 
     
       
         
           
             
               U 
               u 
             
             = 
             
               
                 
                   R 
                   m 
                 
                 - 
                 
                   
                     
                       n 
                       m 
                     
                      
                     
                       ( 
                       
                         
                           n 
                           m 
                         
                         + 
                         1 
                       
                       ) 
                     
                   
                   / 
                   2 
                 
               
               
                 
                   n 
                   m 
                 
                  
                 
                   n 
                   u 
                 
               
             
           
         
       
     
     Modulated (m) and modulated (u) populations are being compared
 
R m =Sum of the ranks modulated population
 
n m =number of cells in the modulated population
 
n u =number of cells in the unmodulated population
         U i  is another value that is the same as U u  except that the isotype control is used as the reference instead of the unmodulated well.       

     
       
         
           
               
             
               
                 TABLE 2 
               
             
            
               
                   
               
               
                 Examples of metrics. 
               
            
           
           
               
               
               
               
            
               
                 Metric Class 
                 Metric 
                 Formal mathematics 
                 Common usage 
               
               
                   
               
               
                 Absolute cell counts 
                 Percent Recovery 
                 
                   
                     
                       
                         
                           
                             
                               
                                 # 
                                  
                                 
                                     
                                 
                                  
                                 cells 
                                  
                                 
                                     
                                 
                                  
                                 observed 
                               
                             
                           
                           
                             
                               
                                 in 
                                  
                                 
                                     
                                 
                                  
                                 a 
                                  
                                 
                                     
                                 
                                  
                                 sample 
                               
                             
                           
                         
                         
                           
                             
                               
                                 # 
                                  
                                 
                                     
                                 
                                  
                                 cells 
                                  
                                 
                                     
                                 
                                  
                                 reported 
                               
                             
                           
                           
                             
                               
                                 in 
                                  
                                 
                                     
                                 
                                  
                                 sample 
                                  
                                 
                                     
                                 
                                  
                                 vial 
                               
                             
                           
                         
                       
                     
                   
                 
                 Summary statistic describing the fraction of the cells that are observed after thawing and ficoll processing of cryopreserved cells 
               
               
                   
               
               
                   
                 Percent Viability 
                 
                   
                     
                       
                         
                           # 
                            
                           
                               
                           
                            
                           cells 
                            
                           
                               
                           
                            
                           Aqua 
                            
                           
                               
                           
                            
                           negative 
                         
                         
                           total 
                            
                           
                               
                           
                            
                           # 
                            
                           
                               
                           
                            
                           cells 
                         
                       
                     
                   
                 
                 Summary statistic describing the fraction of the living cells that are observed from a given vial 
               
               
                   
                   
                   
                 of samples. 
               
               
                   
               
               
                   
                 Percent Healthy 
                 
                   
                     
                       
                         
                           
                             
                               
                                 # 
                                  
                                 
                                     
                                 
                                  
                                 cells 
                                  
                                 
                                     
                                 
                                  
                                 Aqua 
                                  
                                 
                                     
                                 
                                  
                                 negative 
                                  
                                 
                                     
                                 
                                  
                                 and 
                               
                             
                           
                           
                             
                               
                                 cPARP 
                                  
                                 
                                     
                                 
                                  
                                 negative 
                               
                             
                           
                         
                         
                           total 
                            
                           
                               
                           
                            
                           # 
                            
                           
                               
                           
                            
                           cells 
                         
                       
                     
                   
                 
                 Summary statistic describing the fraction of the living non- Apoptotic cells that are observed from a given vial of 
               
               
                   
                   
                   
                 samples. 
               
               
                   
               
               
                   
                 Myeloid Percent Healthy 
                 
                   
                     
                       
                         
                           
                             
                               
                                 # 
                                  
                                 
                                     
                                 
                                  
                                 cells 
                                  
                                 
                                     
                                 
                                  
                                 Aqua 
                                  
                                 
                                     
                                 
                                  
                                 negative 
                               
                             
                           
                           
                             
                               
                                 and 
                                  
                                 
                                     
                                 
                                  
                                 cPARP 
                                  
                                 
                                     
                                 
                                  
                                 negative 
                               
                             
                           
                           
                             
                               
                                 Myeloid 
                                  
                                 
                                     
                                 
                                  
                                 Cells 
                               
                             
                           
                         
                         
                           total 
                            
                           
                               
                           
                            
                           # 
                            
                           
                               
                           
                            
                           cells 
                         
                       
                     
                   
                 
                 Summary statistic describing the fraction of the living non- Apoptotic cells that are observed from a given vial of samples. 
               
               
                   
               
               
                 Fluorescence 
                 MFI (Median 
                   
                 A summary statistic (median) of 
               
               
                 Intensity 
                 Fluorescence 
                   
                 the non-calibrated intensity of 
               
               
                 Metrics 
                 Intensity) 
                   
                 particular fluorescence readouts 
               
               
                   
                 ERF 
                   
                 Used to describe the fluorescence 
               
               
                   
                 (Equivalent 
                   
                 intensity readout as calibrated for 
               
               
                   
                 Reference 
                   
                 the specific instrument on the 
               
               
                   
                 Fluorescence) 
                   
                 specific date of usage. Can be 
               
               
                   
                   
                   
                 applied at the single cell level or 
               
               
                   
                   
                   
                 to bulk properties of cellular 
               
               
                   
                   
                   
                 populations. See U.S. Pat. No. 
               
               
                   
                   
                   
                 8,187,885. 
               
               
                   
               
               
                 Frequencies of cellular populations- univariate 
                 Percent of Cells 
                 
                   
                     
                       
                         
                           
                             
                               
                                 Number 
                                  
                                 
                                     
                                 
                                  
                                 cells 
                               
                             
                           
                           
                             
                               
                                 of 
                                  
                                 
                                     
                                 
                                  
                                 interest 
                               
                             
                           
                         
                         
                           
                             
                               
                                 Number 
                                  
                                 
                                     
                                 
                                  
                                 cells 
                               
                             
                           
                           
                             
                               
                                 Total 
                                  
                                 
                                     
                                 
                                  
                                 population 
                               
                             
                           
                         
                       
                     
                   
                 
                 Describes the fraction of cells of a given type relative to the population. Can be defined as a one-dimensional or 2- dimensional region or gate 
               
               
                   
               
               
                   
                 Percentage Positive 
                 
                   
                     
                       
                         
                           
                             # 
                              
                             
                                 
                             
                              
                             cells 
                           
                           &gt; 
                           Cutoff 
                         
                         
                           
                             
                               
                                 Number 
                                  
                                 
                                     
                                 
                                  
                                 cells 
                               
                             
                           
                           
                             
                               
                                 Total 
                                  
                                 
                                     
                                 
                                  
                                 population 
                               
                             
                           
                         
                       
                     
                   
                 
                 Describes the portion of cells above a given threshold (I.e. a control antibody) of single assay readout 
               
               
                   
               
               
                 Frequencies of cellular populations- bivariate 
                 Quadrant gate “Quad” 
                 
                   
                     
                       
                         
                           
                             
                               
                                 Number 
                                  
                                 
                                     
                                 
                                  
                                 cells 
                               
                             
                           
                           
                             
                               
                                 of 
                                  
                                 
                                     
                                 
                                  
                                 interest 
                               
                             
                           
                           
                             
                               
                                 in 
                                  
                                 
                                     
                                 
                                  
                                 each 
                                  
                                 
                                     
                                 
                                  
                                 quadrant 
                               
                             
                           
                         
                         
                           
                             
                               
                                 Number 
                                  
                                 
                                     
                                 
                                  
                                 cells 
                               
                             
                           
                           
                             
                               
                                 Total 
                                  
                                 
                                     
                                 
                                  
                                 population 
                               
                             
                           
                         
                       
                     
                   
                 
                 Quantitative measure of the percentage of cells in each one of four regions of interest. 
               
               
                   
               
               
                 Fold 
                 Basal 
                 
                   
                     
                       
                         
                           log 
                           2 
                         
                          
                         
                           
                             ERF 
                             unmodulated 
                           
                           
                             ERF 
                             autofluorescence 
                           
                         
                       
                     
                   
                 
                 Describes the magnitude of the activation levels of signaling in the resting, unmodulated state. 
               
               
                   
                   
                   
                 This metric is corrected to 
               
               
                   
                   
                   
                 accommodate the background 
               
               
                   
                   
                   
                 autofluorescence and instrument 
               
               
                   
                   
                   
                 noise. 
               
               
                   
               
               
                   
                 Modulated 
                 
                   
                     
                       
                         
                           log 
                           2 
                         
                          
                         
                           
                             ERF 
                             modulated 
                           
                           
                             ERF 
                             unmodulated 
                           
                         
                       
                     
                   
                 
                 Describes the magnitude of the inducibility or responsiveness of a protein or a signaling pathway 
               
               
                   
                   
                   
                 activation response to modulation. 
               
               
                   
                   
                   
                 This metric is always calculated 
               
               
                   
                   
                   
                 relative to the unmodulated (basal) 
               
               
                   
                   
                   
                 level of activation. 
               
               
                   
                   
                   
                 Autofluorescence and instrument 
               
               
                   
                   
                   
                 noise do not appear in the 
               
               
                   
                   
                   
                 equation since they appear in both 
               
               
                   
                   
                   
                 the numerator and denominator 
               
               
                   
                   
                   
                 (CHECK) 
               
               
                   
               
               
                   
                 Total 
                 
                   
                     
                       
                         
                           log 
                           2 
                         
                          
                         
                           
                             ERF 
                             modulated 
                           
                           
                             ERF 
                             autofluorescence 
                           
                         
                       
                     
                   
                 
                 Used to assess the magnitude of total activated protein. This metric incorporates both basal and 
               
               
                   
                   
                   
                 induced pathway activation. 
               
               
                   
               
               
                   
                 Relative Protein Expression 
                 
                   
                     
                       
                         
                           log 
                           2 
                         
                          
                         
                           
                             ERF 
                             
                               Expression 
                                
                               
                                   
                               
                                
                               Marker 
                             
                           
                           
                             ERF 
                             
                               isotype 
                                
                               
                                   
                               
                                
                               control 
                             
                           
                         
                       
                     
                   
                 
                 Used to measure the amount of surface expression of a particular protein. In this case, the metric is 
               
               
                   
                 “Rel 
                   
                 always calculated relative to the 
               
               
                   
                 Expression” 
                   
                 background level of an isotype 
               
               
                   
                   
                   
                 control and instrument noise. 
               
               
                   
               
               
                 Mann-Whitney U Metrics 
                 U a   
                             R   u     -         n   u          (       n   u     +   1     )       /   2           n   u          n   a           
   Unmodulated (u) and autofluorescence (a) populations are being compared. R u  = Sum of the ranks unmodulated population n u  = number of cells in the unmodulated population n a  = number of cells in the autofluorescence population 
                 This is a rank-based metric. It is used to describe the shift in a population of cells in an unmodulated state relative to the population seen in the autofluorescence (background). All single cell events are used in the calculation. It is formally a scaled Mann- Whitney U metric (AUC). 
               
               
                   
               
               
                   
                 U n   
                             R   m     -         n   m          (       n   m     +   1     )       /   2           n   m          n   u           
   Modulated (m) and unmodulated (u) populations are being compared. R m  = Sum of the ranks unmodulated population n m  = number of cells in the modulated population n u  = number of cells in the unmodulated population 
                 This is a rank-based metric. It is used to describe the shift in a population of cells in a modulated state relative to the population seen in the unmodulated (basal) state. All single cell events are used in the calculation. It is formally a scaled Mann- Whitney U metric (AUC). 
               
               
                   
               
               
                   
                 Percent 
                   
                 Used to describe the ability of a 
               
               
                   
                 Inhibition 
                   
                 compound or other agent to 
               
               
                   
                   
                   
                 modify the activity levels 
               
               
                   
                   
                   
                 (assuming decreased activation) 
               
               
                   
                   
                   
                 of a given measure (e.g. MFI, 
               
               
                   
                   
                   
                 ERF, U u , etc.) 
               
               
                   
               
            
           
         
       
     
     Each protein pair can be further annotated by whether the proteins comprising the pair are connected in a “canonical” pathway. In the current implementation canonical pathways are defined as the pathways curated by the NCI and Nature Publishing Group. This distinction is important; however, it is likely not an exclusive way to delineate which protein pairs to examine. High correlation among proteins in a canonical pathway in a sample may indicate the pathway in that sample is “intact” or consistent with the known literature. One embodiment of the present invention identifies protein pairs that are not part of a canonical pathway with high correlation in a sample as these may indicate the non-normal or pathological signaling. This method will be used to identify stimulator/modulator-stain-stain combinations that distinguish classes of patients. 
     In some embodiments, nodes and/or nodes/metric combinations can be analyzed and compared across sample for their ability to distinguish among different groups (e.g., CR vs. NR patients) using classification algorithms. Any suitable classification algorithm known in the art can be used. Examples of classification algorithms that can be used include, but are not limited to, multivariate classification algorithms such as decision tree techniques: bagging, boosting, random forest, additive techniques: regression, lasso, bblrs, stepwise regression, nearest neighbors or other methods such as support vector machines. 
     In some embodiments, nodes and/or nodes/metric combinations can be analyzed and compared across sample for their ability to distinguish among different groups (e.g., CR vs. NR patients) using random forest algorithm. Random forest (or random forests) is an ensemble classifier that consists of many decision trees and outputs the class that is the mode of the class&#39;s output by individual trees. The algorithm for inducing a random forest was developed by Leo Breiman (Breiman, Leo (2001). “Random Forests”. Machine Learning 45 (1): 5-32. doi: 10.1023/A: 1010933404324) and Adele Cutler. The term came from random decision forests that was first proposed by Tin Kam Ho of Bell Labs in 1995. The method combines Breiman&#39;s “bagging” idea and the random selection of features, introduced independently by Ho (Ho, Tin (1995). “Random Decision Forest”. 3rd Int&#39;l Conf. on Document Analysis and Recognition. pp. 278-282; Ho, Tina (1998). “The Random Subspace Method for Constructing Decision Forests”. IEEE Transactions on Pattern Analysis and Machine Intelligence 20 (8): 832-844. doi: 10.1109/34.709601) and Amit and Geman (Amit, Y.; Geman, D. (1997). “Shape quantization and recognition with randomized trees”. Neural Computation 9 (7): 1545-1588. doi: 10.1 162/neco. 1997.9.7.1545) in order to construct a collection of decision trees with controlled variation. 
     In some embodiments, nodes and/or nodes/metric combinations can be analyzed and compared across sample for their ability to distinguish among different groups (e.g., CR vs. NR patients) using lasso algorithm. The method of least squares is a standard approach to the approximate solution of overdetermined systems, i.e. sets of equations in which there are more equations than unknowns. “Least squares” means that the overall solution minimizes the sum of the squares of the errors made in solving every single equation. The best fit in the least-squares sense minimizes the sum of squared residuals, a residual being the difference between an observed value and the fitted value provided by a model. 
     In some embodiments, nodes and/or nodes/metric combinations can be analyzed and compared across sample for their ability to distinguish among different groups (e.g., CR vs. NR patients) using BBLRS model building methodology. 
     a. Description of the BBLRS Model Building Methodology 
     Production of Bootstrap Samples: 
     A large number of bootstrap samples are first generated with stratification by outcome status to insure that all bootstrap samples have a representative proportion of outcomes of each type. This is particularly important when the number of observations is small and the proportion of outcomes of each type is unbalanced. Stratification under such a scenario is especially critical to the composition of the out of bag (OOB) samples, since only about one-third of observations from the original sample will be included in each OOB sample. 
     Best Subsets Selection of Main Effects: 
     Best subsets selection is used to identify the combination of predictors that yields the largest score statistic among models of a given size in each bootstrap sample. Models having from 1 to 2×N/10 are typically entertained at this stage, where N is the number of observations. This is much larger than the number of predictors generally recommended when building a generalized linear prediction model (Harrell, 2001) but subsequent model building rules are applied to reduce the likelihood of over-fitting. At the conclusion of this step, there will be a “best” main effects model of each size for each bootstrap sample, though the number of unique models of each size may be considerably fewer. 
     Determination of the Optimal Model Size (for Main Effects): 
     Each of the unique “best” models of each size, identified in the previous step, are fit to each of a subset of the bootstrap samples, where the number of bootstrap samples in the subset is under the control of the user (i.e. a tuning parameter) so that the processing time required at this step can be controlled. For each of the bootstrap samples in the subset, the median SBC of the “best” models of the same size is calculated and the model size yielding the lowest median SBC in that bootstrap sample is identified. The optimal model size is then determined as the size for which the median SBC is smallest most often over the subset of bootstrap samples. 
     Identification of the Top Models of the Best Size: 
     At this stage, all previously identified “best” models of the optimal size are fit to every bootstrap sample. A number of top models are then selected as those with the highest values of the margin statistic (a measure from the logistic model of the difference in the predicted probabilities of CR, between NR patients with the highest predicted probabilities and CR patients with the lowest predicted probabilities). In order to limit the processing time required in subsequent steps, the number of top models selected is under the control of the user. 
     Identification of Important Two-Way Interactions: 
     For each of the top main effects models identified in the previous step, models are constructed on every bootstrap sample, with main effects forced into the model and with stepwise selection used to identify important two-way interactions among the set of all possible pair-wise combinations of the main effects. The nominal significance level for entry and removal of interaction terms is under the control of the user. Significance levels greater than 0.05 are often used for entry because of the low power many studies have to detect interactions and because safeguards against over-fitting are applied subsequently. 
     At this stage, collections of full models (main effects and possibly some two-way interactions among them) have been constructed (on the set of all bootstrap samples) for each unique set of main effects identified in the previous step. The top full models in each collection are then chosen as those constructed most frequently over all bootstrap samples, where winners are decided among tied models by the lowest mean SBC and then the highest mean AUROC. The number of full models in each collection that are advanced to the next step is under the control of the user. 
     Selection of the Effects in the Final Model: 
     Each full model advanced to this step is fit to every bootstrap sample and the median margin statistic for each model over the bootstrap samples is calculated. The model with the highest median margin statistic is selected as the final model. If there are ties, the model with the lowest mean SBC is selected. 
     Technically, the procedure described here results in the selection of the effects (main effects and possibly two-way interactions) to be included in the final model, but not specification of the model itself. The latter includes the effects and the specific regression coefficients associated with the intercept and each of the model effects. 
     Specification of the Final Model: 
     The effects in the final model are then fit to the complete dataset using Firth&#39;s method to apply shrinkage to the regression coefficient estimates. The model effects and their estimated regression coefficients (plus the estimate of the intercept) comprise the final model. 
     Another method of the present invention relates to display of information using scatter plots. Scatter plots are known in the art and are used to visually convey data for visual analysis of correlations. See U.S. Pat. No. 6,520,108. The scatter plots illustrating protein pair correlations can be annotated to convey additional information, such as one, two, or more additional parameters of data visually on a scatter plot. 
     Previously, scatter plots used equal size plots to denote all events. However, using the methods described herein two additional parameters can be visualized as follows. First, the diameter of the circles representing the phosphorylation or expression levels of the pair of proteins may be scaled according to another parameter. For example they may be scaled according to expression level of one or more other proteins such as transporters (if more than one protein, scaling is additive, concentric rings may be used to show individual contributions to diameter). 
     Second, additional shapes may be used to indicate subclasses of patients. For example they could be used to denote patients who responded to a second drug regimen or where CRp status. Another example is to show how samples or patients are stratified by another parameter (such as a different stim-stain-stain combination). Many other shapes, sizes, colors, outlines, or other distinguishing glyphs may be used to convey visual information in the scatter plot. 
     In this example the size of the dots is relative to the measured expression and the box around a dot indicates a NRCR patient that is a patient that became CR (Responsive) after more aggressive treatment but was initially NR (Non-Responsive). Patients without the box indicate a NR patient that stayed NR. 
     Applying the methods of the present invention, the Total Phospho metric for p-Akt and p-Stat1 are correlated in response to peroxide (“H 2 O 2 ”) treatment. (Total phoshpho is calculated as shown in  FIGS. 2A-2B , metric #3). On log 2 scale the Pearson correlation coefficient for p-Akt and p-Stat1 in response to HOOH for samples from patients who responded to first treatment is 0.89 and the p-value for linear regression line fit is 0.0075. In contrast there appeared to be no correlation observed for p-Akt and p-Stat1 in HOOH treated samples from patients annotated as “NR” (non-responder) or “NRCR” (initial non-responder, who responded to later more intensive treatment). Further there are no significant correlations observed for these proteins in any patient class for untreated samples. 
     The Total phospho metric for p-Erk and p-CREB also appeared to be correlated in response to IL-3, IL-6, and IL-27 treatment in samples from non-responding patients (NR and NR-CR). When considering all data in log 2 scale the Pearson correlation coefficients for p-Erk and p-CREB in response to IL-3, IL-6, and IL-27 for samples from patients who did not respond to first treatment are 0.74, 0.76, 0.81, respectively, and the respective p-values for linear regression line fits are &lt;0.0001, &lt;0.0001, and &lt;0.0001. In contrast there appeared to be no correlation observed for p-Erk and p-Creb in IL-3, IL-6, and IL-27 experiments for patients annotated as “CR”. (Not shown). Table 3(a) below shows nodes identified by a fold change metric. Table 3(b) below shows node identified by a variety of methods. In some embodiments, the nodes depicted in Tables 3(a) and 3(b) are used according to the methods described herein for classification, diagnosis, prognosis of AML or for the selection of treatment and/or predict outcome after administering a therapeutic. 
     
       
         
           
               
             
               
                 TABLE 3(a) 
               
             
            
               
                   
               
               
                 Nodes Identified by Fold Change Metric  
               
            
           
           
               
               
               
               
               
            
               
                   
                   
                 Relevant Biology/ 
                   
                   
               
               
                 Node 
                 Metric 
                 Known Role in AML  
                 p-Val 
                 AUC 
               
               
                   
               
               
                 SDF-1 → p-Akt 
                 Fold  
                 BM Chemokine  
                 .025  
                 .71  
               
               
                   
                 Change  
                   
                   
                   
               
               
                 SCF → p-Akt 
                 Fold  
                 Stem Cell Growth Factor  
                 .018  
                 .809  
               
               
                   
                 Change  
                 Upreg, Mutated In AML  
                   
                   
               
               
                 SCF→ p-S6  
                 Fold  
                 Stem Cell Growth Factor  
                 .055  
                 .66  
               
               
                   
                 Change  
                 Upreg, Mutated In AML  
                   
                   
               
               
                 FLT3L→ p-Akt  
                 Fold  
                 Growth Factor  
                 .003  
                 .82  
               
               
                   
                 Change  
                 Mutated In AML  
                   
                   
               
               
                 FLT3L→ p-S6  
                 Fold  
                 Growth Factor  
                 .026  
                 .66  
               
               
                   
                 Change  
                 Mutated In AML  
                   
                   
               
               
                 G-CSF→ p-Stat3  
                 Fold  
                 Myeloid Growth Factor  
                 .090  
                 .68  
               
               
                   
                 Change  
                   
                   
                   
               
               
                 G-CSF→ p-Stat5  
                 Fold  
                 Myeloid Growth Factor  
                 .038  
                 .70  
               
               
                   
                 Change  
                   
                   
                   
               
               
                 Peroxide → p-Slp-76  
                 Fold  
                 Phosphatase Inhibition  
                 .02  
                 .78  
               
               
                   
                 Change  
                 Novel AML Biology  
                   
                   
               
               
                 Peroxide → p-Plcγ2  
                 Fold  
                 Phosphatase Inhibition  
                 .09  
                 .75  
               
               
                   
                 Change  
                 Novel AML Biology  
                   
                   
               
               
                 IFNa → p-Stat1  
                 Fold  
                   
                 .017  
                 .747  
               
               
                   
                 Change  
                   
                   
                   
               
               
                 IFNγ → p-Stat1 
                 Fold  
                   
                 .038  
                 .707  
               
               
                   
                 Change  
                   
                   
                   
               
               
                 Thapsi → p-S6  
                 Fold  
                 Pharmacological stim  
                 .020  
                 .707  
               
               
                   
                 Change  
                   
                   
                   
               
               
                 PMA → p-Erk  
                 Fold  
                 Pharmacological stim  
                 .062  
                 .702  
               
               
                   
                 Change 
               
               
                   
               
            
           
         
       
     
     
       
         
           
               
             
               
                 TABLE 3(b) 
               
             
            
               
                   
               
               
                 Nodes identified by Variety of Metrics  
               
            
           
           
               
               
               
               
               
            
               
                   
                   
                 Relevant Biology/ 
                   
                   
               
               
                 Node 
                 Metric 
                 Known Role in AML  
                 p-Val 
                 AUC 
               
               
                   
               
               
                 Etoposide → cleaved  
                 Quadrant  
                 DNA damage &amp;  
                 .001  
                 .82  
               
               
                 PARP+ p-Chk2-  
                 Gate  
                 Apoptosis  
                   
                   
               
               
                   
                 Frequency  
                   
                   
                   
               
               
                 p-Creb  
                 Basal  
                 Over-expressed in  
                 .0005  
                 .87  
               
               
                   
                   
                 AML  
                   
                   
               
               
                 p-Erk  
                 Basal  
                 Activated in AML  
                 .02  
                 .77  
               
               
                 p-Stat6  
                 Basal  
                 Novel AML Biology  
                 .008  
                 .76  
               
               
                 p-Plcγ2  
                 Basal  
                 Novel AML Biology  
                 .007  
                 .79  
               
               
                 p-Stat3  
                 Basal  
                 Activated in AML  
                 .005  
                 .81  
               
               
                 IL-27 → p-Stat3  
                 Total  
                 p-Stat3 Active in  
                 .00004  
                 .80  
               
               
                   
                   
                 AML  
                   
                   
               
               
                 IL-10 → p-Stat3  
                 Total  
                 p-Stat3 Active in  
                 .0009  
                 .84  
               
               
                   
                   
                 AML  
                   
                   
               
               
                 IL-6 → p-Stat3  
                 Total  
                 p-pStat3 Active in  
                 .001  
                 .77  
               
               
                   
                   
                 AML  
                   
                   
               
               
                 Etopo + Zvad → 
                 Total  
                 Apoptosis  
                   
                   
               
               
                 Cleaved Caspse 3  
                   
                   
                   
                   
               
               
                 ABCG2  
                 % Positive  
                 Drug Transporter  
                 .00093  
                 .75  
               
               
                   
                 Above  
                   
                   
                   
               
               
                   
                 Isotype  
                   
                   
                   
               
               
                 C-KITR  
                 Fold over  
                 Growth Factor  
                 .012  
                 .78  
               
               
                   
                 Isotype  
                 Receptor  
                   
                   
               
               
                 FLT3R  
                 Fold over  
                 Growth Factor  
                 .0004  
                 .82  
               
               
                   
                 Isotype  
                 Receptor 
               
               
                   
               
            
           
         
       
     
     In some embodiments, analyses are performed on healthy cells. In some embodiments, the health of the cells is determined by using cell markers that indicate cell health. In some embodiments, cells that are dead or undergoing apoptosis will be removed from the analysis. In some embodiments, cells are stained with apoptosis and/or cell death markers such as PARP or Aqua dyes. Cells undergoing apoptosis and/or cells that are dead can be gated out of the analysis. In other embodiments, apoptosis is monitored over time before and after treatment. For example, in some embodiments, the percentage of healthy cells can be measured at time zero and then at later time points and conditions such as: 24 h with no modulator, and 24 h with Ara-C/Daunorubicin. In some embodiments, the measurements of activatable elements are adjusted by measurements of sample quality for the individual sample, such as the percent of healthy cells present. 
     In some embodiments, a regression equation will be used to adjust raw node readout scores for the percentage of healthy cells at 24 hours post-thaw. In some embodiments, means and standard deviations will be used to standardize the adjusted node readout scores. 
     Before applying the SCNP classifier, raw node-metric signal readouts (measurements) for samples will be adjusted for the percentage of healthy cells and then standardized. The adjustment for the percentage of healthy cells and the subsequent standardization of adjusted measurements is applied separately for each of the node-metrics in the SCNP classifier. 
     The following formula can be used to calculate the adjusted, normalized node-metric measurement (z) for each of the node-metrics of each sample. 
         z =(( x −( b   0   +b   1 ×pcthealthy))−residual_mean)/residual_sd,
 
     where x is the raw node-metric signal readout, b 0  and b 1  are the coefficients from the regression equation used to adjust for the percentage of healthy cells (pcthealthy), and residual_mean and residual_sd are the mean and standard deviation, respectively, for the adjusted signal readouts in the training set data. The values of b 0 , b 1 , residual_mean, and residual_sd for each node-metric are included in the embedded object below, with values of the latter two parameters stored in variables by the same name. The values of the b 0  and b 1  parameters are contained on separate records in the variable named “estimate”. The value for b 0  is contained on the record where the variable “parameter” is equal to “Intercept” and the value for b 1  is contained on the record where the variable “parameter” is equal to “percenthealthy24Hrs”. The value of pcthealthy will be obtained for each sample as part of the standard assay output. The SCNP classifier will be applied to the z values for the node-metrics to calculate the continuous SCNP classifier score and the binary induction response assignment (pNR or pCR) for each sample. 
     In some embodiments, the measurements of activatable elements are adjusted by measurements of sample quality for the individual cell populations or individual cells, based on markers of cell health in the cell populations or individual cells. Examples of analysis of healthy cells can be found in U.S. application Ser. No. 61/374,613 filed Aug. 18, 2010, the content of which is incorporated herein by reference in its entirety for all purposes. 
     In some embodiments, the invention provides methods of diagnosing, prognosing, determining progression, predicting a response to a treatment or choosing a treatment for AML in an individual, the method comprising: (1) classifying one or more hematopoietic cells associated with AML in said individual by a method comprising: a) subjecting a cell population comprising said one or more hematopoietic cells from said individual to modulator conditions, b) determining an activation level of activatable elements in one or more cells from said individual, and c) classifying said one or more hematopoietic cells based on said activation levels in response to modulator conditions using multivariate classification algorithms such as decision tree techniques: bagging, boosting, random forest, additive techniques: regression, lasso, bblrs, stepwise regression, nearest neighbors or other methods such as support vector machines (2) making a decision regarding a diagnosis, prognosis, progression, response to a treatment or a selection of treatment for AML in said individual based on said classification of said one or more hematopoietic cells. In some embodiments, classifying further comprises identifying a difference in kinetics of said activation level. In some embodiments, the measurements of activatable elements are made only in healthy cells as determined using markers of cell health. In some embodiments, the measurements of activatable elements are adjusted by measurements of sample quality for the individual sample, such as the percent of healthy cells present. 
     Drug Screening 
     Another embodiment of the present invention is a method for screening drugs that are in development and indicated for patients that have been diagnosed with acute myelogenous leukemia (AML), myelodysplasia (MDS) or myelodyspastic syndrome (MPN). 
     Using the signaling nodes and methodology described herein, multiparametric flow cytometry could be used in-vitro to predict both on and off-target cell signaling effects. Using an embodiment of the present invention, the bone marrow or peripheral blood obtained from a patient diagnosed with AML could be divided and part of the sample subjected to a therapeutic. Modulators (e.g. GM-CSF or PMA) could then be added to the untreated and treated specimens. Activatable elements (e.g. JAKs/STATs/AKT), including the proposed target of the therapeutic, or those that may be affected by the therapeutic (off-target) can then be assessed for an activation state. This activation state can be used to predict the therapeutics&#39; potential for on and off target effects prior to first in human studies. 
     Using the signaling nodes and methodology described herein, one embodiment of the present invention, such as multiparametric flow cytometry, could be used after in-vivo exposure to a therapeutic in development for patients that have been diagnosed with AML to determine both on and off-target effects. Using an embodiment of the present invention, the bone marrow or peripheral blood (fresh, frozen, ficoll purified, etc.) obtained from a patient diagnosed with AML or MDS at time points before and after exposure to a given therapeutic may be subjected to a modulator as above. Activatable elements (e.g. JAKs/STATs/AKT), including the proposed target of the therapeutic, or those that may be affected by the therapeutic (off-target) can then be assessed for an activation state. This activation state can then be used to determine the on and off target signaling effects on the bone marrow or blast cells. 
     The apoptosis and peroxide panel study may reveal new biological classes of stratifying nodes for drug screening. Some of the important nodes could include changes on levels of p-Lck, pSlp-76, p PLCγ2, in response to peroxide alone or in combination with growth factors or cytokines. These important nodes are induced Cleaved Caspase 3 and Cleaved Caspase 8, and etoposide induced p-Chk2, peroxide (H 2 O 2 ) induced p-SLP-76, peroxide (H 2 O 2 ) induced p-PLCγ2 and peroxide (H 2 O 2 ) induced P-Lck. The apoptosis panel may include but is not limited to, detection of changes in phosphorylation of Chk2, changes in amounts of cleaved caspase 3, cleaved caspase 8, cleaved poly (ACP ribose) polymerase PARP, cytochrome C released from the mitochondria these apoptotic nodes are measured in response to agents that included but are not limited to DNA damaging agents such as Etoposide, Mylotarg, AraC and daunorubicin either alone or in combination as well as to the global kinase inhibitor staurosporine. 
     Using the signaling nodes and methodology described herein, multiparametric flow cytometry could be used to find new target for treatment (e.g. new druggable targets). Using an embodiment of the present invention, the bone marrow or peripheral blood obtained from a patient diagnosed with AML could be divided and part of the sample subjected to one or more modulators (e.g. GM-CSF or PMA). Activatable elements (e.g. JAKs/STATs/AKT) can then be assessed for an activation state. This activation state can be used to predict find new target molecule for new existing therapeutics. These therapeutics can be used alone or in combination with other treatments for the treatment of AML, MDS or MPN. 
     Kits 
     In some embodiments the invention provides kits. Kits provided by the invention may comprise one or more of the state-specific binding elements described herein, such as phospho-specific antibodies. A kit may also include other reagents that are useful in the invention, such as modulators, fixatives, containers, plates, buffers, therapeutic agents, instructions, and the like. A kit can be used to assay for one or more cell health markers. A kit can be used to assay for one or more markers of apoptosis and/or necrosis. See U.S. Pat. No. 8,242,248. 
     In some embodiments, the kit comprises one or more of the phospho-specific antibodies specific for the proteins selected from the group consisting of PI3-Kinase (p85, p110a, p110b, p110d), Jak1, Jak2, SOCs, Rac, Rho, Cdc42, Ras-GAP, Vav, Tiam, Sos, Dbl, Nck, Gab, PRK, SHP1, and SHP2, SHIP1, SHIP2, sSHIP, PTEN, Shc, Grb2, PDK1, SGK, Akt1, Akt2, Akt3, TSC1,2, Rheb, mTor, 4EBP-1, p70S6Kinase, S6, LKB-1, AMPK, PFK, Acetyl-CoAa Carboxylase, DokS, Rafs, Mos, Tpl2, MEK1/2, MLK3, TAK, DLK, MKK3/6, MEKK1,4, MLK3, ASK1, MKK4/7, SAPK/JNK1,2,3, p38s, Erk1/2, Syk, Btk, BLNK, LAT, ZAP70, Lck, Cbl, SLP-76, PLCγ1, PLCγ 2, STAT1, STAT 3, STAT 4, STAT 5, STAT 6, FAK, p130CAS, PAKs, LIMK1/2, Hsp90, Hsp70, Hsp27, SMADs, Rel-A (p65-NFKB), CREB, Histone H2B, HATs, HDACs, PKR, Rb, Cyclin D, Cyclin E, Cyclin A, Cyclin B, P16, p14Arf, p27KIP, p21CIP, Cdk4, Cdk6, Cdk7, Cdk1, Cdk2, Cdk9, Cdc25, A/B/C, Abl, E2F, FADD, TRADD, TRAF2, RIP, Myd88, BAD, Bcl-2, Mcl-1, Bcl-XL, Caspase 2, Caspase 3, Caspase 6, Caspase 7, Caspase 8, Caspase 9, IAPs, Smac, Fodrin, Actin, Src, Lyn, Fyn, Lck, NIK, IκB, p65(RelA), IKKα, PKA, PKCα, PKCβ, PKCθ, PKCδ, CAMK, Elk, AFT, Myc, Egr-1, NFAT, ATF-2, Mdm2, p53, DNA-PK, Chk1, Chk2, ATM, ATR, β (tilde over the beta)catenin, CrkL, GSK3α, GSK3β, and FOXO. In some embodiments, the kit comprises one or more of the phospho-specific antibodies specific for the proteins selected from the group consisting of Erk, Syk, Zap70, Lck, Btk, BLNK, Cbl, PLCγ2, Akt, RelA, p38, S6. In some embodiments, the kit comprises one or more of the phospho-specific antibodies specific for the proteins selected from the group consisting of Akt1, Akt2, Akt3, SAPK/JNK1,2,3, p38s, Erk1/2, Syk, ZAP70, Btk, BLNK, Lck, PLCγ, PLCγ 2, STAT1, STAT 3, STAT 4, STAT 5, STAT 6, CREB, Lyn, p-S6, Cbl, NF-κB, GSK3β, CARMA/Bcl10 and Tcl-1. 
     One embodiment uses a kit having the following reagents: Phenotyping, DNA content, and signaling reagents. Specifically, the kit includes Phenotyping, including CytoKeratin FITC, EpCAM PerCP-Cy5.5, CD45 PE-Cy7; DNA Content, including DAPI; Apoptosis, including cPARP AF700; and Intracellular Signaling including, pERK PE, pAKT AF647. 
     The state-specific binding element described herein can be conjugated to a solid support and to detectable groups directly or indirectly. The reagents can also include ancillary agents such as buffering agents and stabilizing agents, e.g., polysaccharides and the like. The kit can further include, where necessary, other members of the signal-producing system of which system the detectable group is a member (e.g., enzyme substrates), agents for reducing background interference in a test, control reagents, apparatus for conducting a test, and the like. The kit can be packaged in any suitable manner, typically with all elements in a single container along with a sheet of printed instructions for carrying out the test. 
     Such kits enable the detection of activatable elements by sensitive cellular assay methods, such as IHC and flow cytometry, which are suitable for the clinical detection, prognosis, and screening of cells and tissue from patients, such as leukemia patients, having a disease involving altered pathway signaling. 
     Such kits can additionally comprise one or more therapeutic agents. The kit can further comprise a software package for data analysis of the physiological status, which can include reference profiles for comparison with the test profile. 
     Such kits can also include information, such as scientific literature references, package insert materials, clinical trial results, and/or summaries of these and the like, which indicate or establish the activities and/or advantages of the composition, and/or which describe dosing, administration, side effects, drug interactions, or other information useful to the health care provider. Such information can be based on the results of various studies, for example, studies using experimental animals involving in vivo models and studies based on human clinical trials. Kits described herein can be provided, marketed and/or promoted to health providers, including physicians, nurses, pharmacists, formulary officials, and the like. Kits can also, in some embodiments, be marketed directly to the consumer. 
     In some embodiments, the invention provides a kit comprising: (a) at least two modulators selected from the group consisting of Staurosporine, Etoposide, Mylotarg, Daunorubicin, AraC, G-CSF, IFNg, IFNa, IL-27, IL-3, IL-6, IL-10, FLT3L, SCF, G-CSF, SCF, G-CSF, SDF1a, LPS, PMA, Thapsigargin and H 2 O 2 ; b) at least three binding elements specific to a particular activation state of the activatable element selected from the group consisting of p-Slp-76, p-Plcgamma2, p-Stat3, p-Stat5, p-Stat1, p-Stat6, P-Creb, Cleaved PARP (Parp+), Chk2, Rel-A (p65-NFKB), p-AKT, p-S6, p-ERK, Cleaved Caspase 8, Cytoplasmic Cytochrome C, and p38; and (c) instructions for diagnosis, prognosis, determining acute myeloid leukemia progression and/or predicting response to a treatment for acute myeloid leukemia in an individual. In some embodiments, the kit further comprises a binding element specific for a cytokine receptor or drug transporter are selected from the group consisting of MDR1, ABCG2, MRP, P-Glycoprotein, CXCR4, FLT3, and c-kit. In some embodiments, the binding element is an antibody. 
     The following examples serve to more fully describe the manner of using the above-described invention, as well as to set forth the best modes contemplated for carrying out various aspects described herein. It is understood that these examples in no way serve to limit the true scope of this invention, but rather are presented for illustrative purposes. All references cited herein are expressly incorporated by reference in their entireties. 
     EXAMPLES 
     Example 1 
     Materials and Methods 
     The present illustrative example represents how to analyze cells in one embodiment of the present invention. There are several steps in the process, such as the stimulation step, the staining step and the flow cytometry step. The stimulation step of the phospho-flow procedure can start with vials of frozen cells and end with cells fixed and permeabilized in methanol. Then the cells can be stained with an antibody directed to a particular protein of interest and then analyzed using a flow cytometer. 
     The materials used in this invention include thawing medium which comprises PBS-CMF+10% FBS+2 mM EDTA; 70 um Cell Strainer (BD); anti-CD45 antibody conjugated to Alexa 700 (Invitrogen) used at 1 ul per sample; propidium iodide (PI) solution (Sigma 10 ml, 1 mg/ml) used at 1 ug/ml; RPMI+1% FBS medium; media A comprising RPMI+1% FBS+1× Penn/Strep; Live/Dead Reagent, Amine Aqua (Invitrogen); 2 ml, 96-Deep Well, U-bottom polypropylene plates (Nunc); 300 ul 96-Channel Extended-Length D.A.R.T. tips for Hydra (Matrix); Phosphate Buffered Saline (PBS) (MediaTech); 16% Paraformaldehyde (Electron Microscopy Sciences); 100% Methanol (EMD) stored at −20 C; Transtar 96 dispensing apparatus (Costar); Transtar 96 Disposable Cartridges (Costar, Polystyrene, Sterile); Transtar reservoir (Costar); and foil plate sealers. 
     a. Thawing Cell and Live/Dead Staining: 
     Frozen cells are thawed in a 37° C. water bath and gently resuspended in the vial and transferred to the 15 mL conical tube. The 15 mL tube is centrifuged at 930 RPM (200×g) for 8 minutes at room temperature. The supernatant is aspirated and the pellet is gently resuspended in 1 mL media A. The cell suspension is filtered through a 70 um cell strainer into a new 15 mL tube. The cell strainer is rinsed with 1 mL media A and another 12 ml of media A into the 15 mL tube. The cells are mixed into an even suspension. A 20 μL aliquot is immediately removed into a 96-well plate containing 180 μL PBS+4% FBS+CD45 Alexa 700+PI to determine cell count and viability post spin. After the determination, the 15 mL tubes are centrifuged at 930 RPM (200×g) for 8 minutes at room temperature. The supernatant is aspirated and the cell pellet is gently resuspended in 4 mL PBS+4 μL Amine Aqua and incubated for 15 min in a 37° C. incubator. 10 mL RPMI+1% FBS is added to the cell suspension and the tube is inverted to mix the cells. The 15 mL tubes are centrifuged at 930 RPM (200×g) for 8 minutes at room temperature. The cells are resuspended in Media A at the desired cell concentration (1.25×10 6 /mL). For samples with low numbers of cells (&lt;18.5×10 6 ), the cells are resuspended in up to 15 mL media. For samples with high numbers of cells (&gt;18.5×10 6 ), the volume is raised to 10 mL with media A and the desired volume is transferred to a new 15 mL tube, and the cell concentration is adjusted to 1.25×10 6  cells/ml. 1.6 mL of the above cell suspension (concentration at 1.25×10 6  cells/ml) is transferred into wells of a multi-well plate. From this plate, 80 ul is dispensed into each well of a subsequent plate. The plates are covered with a lid (Nunc) and placed in a 37° C. incubator for 2 hours to rest. 
     b. Cell Stimulation: 
     A concentration for each stimulant that is five folds more (5×) than the final concentration is prepared using Media A as diluent. 5× stimuli are arrayed into wells of a standard 96 well v-bottom plate that correspond to the wells on the plate with cells to be stimulated. 
     Preparation of fixative: Stock vial contains 16% paraformaldehyde which is diluted with PBS to a concentration that is 1.5×. The stock vial is placed in a 37° C. water bath. 
     Adding the stimulant: The cell plate(s) are taken out of the incubator and placed in a 37° C. water bath next to the pipette apparatus. The cell plate is taken from the water bath and gently swirled to resuspend any settled cells. With pipettor, the stimulant is dispensed into the cell plate and vortexed at “7” for 5 seconds. The deep well plate is put back into the water bath. 
     Adding Fixative: 200 μl of the fixative solution (final concentration at 1.6%) is dispensed into wells and then mixed on the titer plate shaker on high for 5 seconds. The plate is covered with foil sealer and incubated in a 37° C. water bath for 10 minutes. The plate is spun for 6 minutes at 2000 rpm at room temperature. The cells are aspirated using a 96 well plate aspirator (VP Scientific). The plate is vortexed to resuspend cell pellets in the residual volume. The pellet is ensured to be dispersed before the Methanol step (see cell permeabilization) or clumping will occur. 
     Cell Permeabilization: Permeability agent, for example methanol, is added slowly and while the plate is vortexing. To do this, the cell plate is placed on titer plate shaker and made sure it is secure. The plate is set to shake using the highest setting. A pipetter is used to add 0.6 mls of 100% methanol to the plate wells. The plate(s) are put on ice until this step has been completed for all plates. Plates are covered with a foil seal using the plate roller to achieve a tight fit. At this stage the plates can be stored at −80° C. 
     c. Staining Protocol 
     Reagents for staining include FACS/Stain Buffer-PBS+0.1% Bovine serum albumen (BSA)+0.05% Sodium Azide; Diluted Bead Mix-1 mL FACS buffer+1 drop anti-mouse Ig Beads+1 drop negative control beads. The general protocol for staining cells is as follows, although numerous variations on the protocol may be used for staining cells: 
     Cells are thawed if frozen. Cells are pelleted at 2000 rpm 5 minutes. Supernatant is aspirated with vacuum aspirator. Plate is vortexed on a “plate vortex” for 5-10 seconds. Cells are washed with 1 mL FACS buffer. Repeat the spin, aspirate and vortex steps as above. 50 μL of FACS/stain buffer with the desired, previously optimized, antibody cocktail is added to two rows of cells at a time and agitate the plate. The plate is covered and incubated in a shaker for 30 minutes at room temperature (RT). During this incubation, the compensation plate is prepared. For the compensation plate, in a standard 96 well V-bottom plate, 20 μL of “diluted bead mix” is added per well. Each well gets 5 μL of 1 fluorophor conjugated control IgG (examples: Alexa488, PE, Pac Blue, Aqua, Alexa647, Alexa700). For the Aqua well, add 200 uL of Aqua−/+ cells. Incubate the plate for 10 minutes at RT. Wash by adding 200 μL FACS/stain buffer, centrifuge at 2000 rpm for 5 minutes, and remove supernatant. Repeat the washing step and resuspend the cells/beads in 200 μL FACS/stain buffer and transfer to a U-bottom 96 well plate. After 30 min, 1 mL FACS/stain buffer is added and the plate is incubated on a plate shaker for 5 minutes at room temperature. Centrifuge, aspirate and vortex cells as described above. 1 mL FACS/stain buffer is added to the plate and the plate is covered and incubated on a plate shaker for 5 minutes at room temperature. Repeat the above two steps and resuspend the cells in 75 μl FACS/stain buffer. The cells are analyzed using a flow cytometer, such as a LSRII (Becton Disckinson). All wells are selected and Loader Settings are described below: Flow Rate: 2 uL/sec; Sample Volume: 40 uL; Mix volume: 40 uL; Mixing Speed: 250 uL/sec; # Mixes: 5; Wash Volume: 800 uL; STANDARD MODE. When a plate has completed, a Batch analysis is performed to ensure no clogging. 
     d. Gating Protocol 
     Data acquired from the flow cytometer are analyzed with Flowjo software (Treestar, Inc). The Flow cytometry data is first gated on single cells (to exclude doublets) using Forward Scatter Characteristics Area and Height (FSC-A, FSC-H). Single cells are gated on live cells by excluding dead cells that stain positive with an amine reactive viability dye (Aqua-Invitrogen). Live, single cells are then gated for subpopulations using antibodies that recognize surface markers as follows: CD45++, CD33− for lymphocytes, CD45++, CD33++ for monocytes+granulocytes and CD45+, CD33+ for leukemic blasts. Signaling, determined by the antibodies that interact with intracellular signaling molecules, in these subpopulation gates that select for “lymphs”, “monos+grans, and “blasts” is analyzed. 
     e. Gating of Flow Cytometry Data to Identify Live Cells and the Lymphoid and Myeloid Subpopulations: 
     Flow cytometry data can be analyzed using several commercially available software programs including FACSDiva™, FlowJo, and Winlist™. The initial gate is set on a two-parameter plot of forward light scatter (FSC) versus side light scatter (SSC) to gate on “all cells” and eliminate debris and some dead cells from the analysis. A second gate is set on the “live cells” using a two-parameter plot of Amine Aqua (a dye that brightly stains dead cells, commercially available from Invitrogen) versus SSC to exclude dead cells from the analysis. Subsequent gates are be set using antibodies that recognize cell surface markers and in so doing define cell sub-sets within the entire population. A third gate is set to separate lymphocytes from all myeloid cells (acute myeloid leukemia cells reside in the myeloid gate). This is done using a two-parameter plot of CD45 (a cell surface antigen found on all white blood cells) versus SSC. The lymphocytes are identified by their characteristic high CD45 expression and low SSC. The myeloid population typically has lower CD45 expression and a higher SSC signal allowing these different populations to be discriminated. The gated region containing the entire myeloid population is also referred to as the P1 gate. 
     f. Phenotypic Gating to Identify Subpopulations of Acute Myeloid Leukemia Cells: 
     The antibodies used to identify subpopulations of AML blast cells are CD34, CD33, and CD11b. The CD34 +  CD11b −  blast population represents the most immature phenotype of AML blast cells. This population is gated on CD34 high and CD11b negative cells using a two-parameter plot of CD34 versus CD11b. The CD33 and CD11b antigens are used to identify AML blast cells at different stages of monocytic differentiation. All cells that fall outside of the CD34 +  CD11b −  gate described above (called “Not CD34+”) are used to generate a two-parameter plot of CD33 versus CD11b. The CD33 +  CD11b hi  myeloid population represents the most differentiated monocytic phenotype. The CD33 +  CD11b intermediate  and CD33 +  CD11b lo  populations represent less differentiated monocytic phenotypes. 
     The data can then be analyzed using various metrics, such as basal level of a protein or the basal level of phosphorylation in the absence of a stimulant, total phosphorylated protein, or fold change (by comparing the change in phosphorylation in the absence of a stimulant to the level of phosphorylation seen after treatment with a stimulant), on each of the cell populations that are defined by the gates in one or more dimensions. These metrics are then organized in a database tagged by: the Donor ID, plate identification (ID), well ID, gated population, stain, and modulator. These metrics tabulated from the database are then combined with the clinical data to identify nodes that are correlated with a pre-specified clinical variable (for example; response or non response to therapy) of interest. 
     Example 2 
     Multi-parameter flow cytometric analysis was performed on peripheral blasts taken at diagnosis from 9 AML patients who achieved a complete response (CR) and 24 patients who were non-responders (NR) to one cycle of standard 7+3 induction therapy (100-200 mg/m2 cytarabine and 60 mg/m2 daunorubicin). The signaling nodes were organized into 4 biological categories: 1) Protein expression of receptors and drug transporters 2) Response to cytokines and growth factors, 3) Phosphatase activity, and 4) Apoptotic signaling pathways. 
     The data showed that expression of the receptors for c-Kit and FLT3 Ligand and the drug transporter ABCG2, were increased in patients who achieved an NR versus CR (data not shown). Readouts from the cytokine-Stat response panels and the growth factor-Map kinase and PI3-Kinase response panels (see Table 4) revealed increased signaling in blasts taken from NR patients versus blasts taken from patients who clinically responded to therapy. To determine the role of phosphatases, peroxide, (H 2 O 2 ) a physiologic phosphatase inhibitor revealed increased phosphatase activity in CRs versus NRs for some signaling molecules and increased phosphatase activity in NRs versus CRs for others. In the absence of treatment with H 2 O 2 , CRs had lower levels of phosphorylated PLCγ2 and SLP-76 versus NRs, and attained higher levels of phosphorylated PLCγ2 and SLP-76 upon H 2 O 2  treatment. In contrast, H 2 O 2  revealed higher levels of p-Akt in NR patients versus CR patients. Lastly, interrogation of the apoptotic machinery using agents such as staurosporine and etoposide showed that NR patient blasts failed to undergo cell death, as determined by cleaved PARP and cleaved Caspase 8. Of note, in NR patient blasts, these agents did promote an increase in phosphorylated Chk2 suggesting a communication breakdown between the DNA damage response pathway and the apoptotic machinery. In contrast, blasts from CR patients showed significant populations of cells with cleaved PARP and caspase 8 consistent with their clinical outcomes. 
     In this study, 152 signaling nodes per patient sample were measured by multi-parameter flow cytometry and revealed distinct signaling profiles that correlate with patient response to ara-C based induction therapy. This study identified 29 individuals nodes strongly associated (i.e. AUC &gt;0.7, p value 0.05) with clinical response to 1 cycle of ara-C based induction therapy. Most of these nodes were highly correlated. Table 4 below shows 26 of the 29 nodes strongly associated with clinical responses. Expression levels of c-Kit, Flt-3L receptors and ABCG2 drug transporter also associated with clinical responses. 
     Alterations were seen in expression for the c-Kit and Flt-3L receptors, the ABCG2 drug transporter, cytokine and growth factor pathway response, phosphatase activity and apoptotic response, all of which could stratify the NR from the CR patient subsets. 
     It was also determined that evoked signaling to biologically relevant modulators reveals nodes that stratify non-responding patients from complete responders in this AML sample set. For example,  FIG. 4  shows different activation profiles for NR patients. The operative pathways in these patients can be used to predict response to a treatment or to choose a specific treatment for the patients.  FIG. 4  shows that NR patients in subset 1 have high levels of p-Stat3 and p-Stat5 in response to G-CSF. This suggests that JAK, Src and other new therapeutics could be good candidates for the treatment of these patients. In addition,  FIG. 4  shows that NR patients in subset 2 have high levels of p-Akt and p-S6 in response to FLT3L. This suggests that inhibitors to FLT3R, PI-3K/mTor and other new therapeutics could be good candidates for the treatment of these patients.  FIG. 4  also shows that NR patients in subset 2 have high levels of p-Stat3 and p-Stat5 in response to G-CSF, high levels of p-Akt and p-S6 in response to FLT3L, and high levels of p-Akt and p-S6 in response to SCF. This suggests that inhibitors to JAK, Src, FLT3R, PI-3K/mTor, RKT inhibitors and other new therapeutics could be good candidates for the treatment of these patients. 
     However, some patients with a functional apoptosis response to Etoposide as measured by p-Chk2 and cleaved PARP have a CR phenotype despite having high levels of p-Stat3 and p-Stat5 in response to G-CSF (data not shown). Even though high levels of p-Stat3 and p-Stat5 in response to G-CSF is associated with NR, if the apoptotic machinery is still active the patient might be able to respond to treatment. This suggests that there may be a requirement for more than one signaling pathway to prevent or veto apoptosis. In this case G-CSF signaling is not able alone to prevent apoptosis. These results indicate that multivariate analysis of signaling nodes can improve the specificity of the patient stratification. 
     Although univariate analysis of signaling nodes can stratify patients based on response to induction therapy as several predictive nodes were independent of each other, multivariate analysis of signaling nodes can improve specificity while providing insight into the pathophysiology of the disease/potential response to therapy. Combination of two independent nodes, p-Stat5-CSF and p-Akt-FLT3L, can classify correctly all CR (but one CRp) and misclassify only 5 NR (not shown). 
     Additionally, Phospho-Flow technology allows detection of multiple signaling subpopulations within the AML blast population which could be instrumental in disease monitoring and following rare populations after therapy. See  FIG. 4  and not shown. Overall, phospho-flow identifies patient subgroups of AML with different clinical outcomes to induction therapy, reveals mechanisms of potential pathophysiology, and provides a tool for personalized treatment options based on unique patient-specific signaling networks and for disease monitoring under therapeutic pressure. 

 
     Example 3 
     An analysis of a heterogeneous population of AML patients may be conducted as outlined above. The results may show the following. In some embodiments, univariate analysis is performed on relatively homogeneous clinical groups, such as patents over 60 years old, patients under 60 years old, de novo AML patients, and secondary AML patients. In other embodiments the groups may be molecularly homogeneous groups, such as Flt-3-ITD WT. For example, in patients over 60 years old, NRs may have a higher H 2 O 2  response than CRs and/or a higher FLT3L response than CRs. In patients under 60, NRs may have a higher IL-27 response than CRs and/or CRs may induce apoptosis to Etoposide or Ara-C/Daunorubicin more than NRs. In de novo AML, CRs may induce apoptosis (cleaved PARP) in response to Etoposide or Ara-C/Daunorubicin, they may have higher total p-S6 levels than NRs, or NRs may have higher H 2 O 2  response than CRs. In secondary AML, NRs may have higher H 2 O 2  responses than CRs, NRs may have higher FLT3L, SCF response than CRs, NRs may have higher G-CSF, IL-27 response than CRs, and there may be overlapping nodes with the over 60 patient set. The following tables may illustrate the above. The tables show the node, metric, and patient subpopulations. For example, the node can be shown as the node (readout) followed by the stimulant/modulator, and in some instances the receptor through which they act (Table 11 also lists some labels that can be employed in the readout). The metric is the way the result may be calculated (see definitions above and in the figures; ppos is percent positive). The leukemic blast cell subpopulations are: P1 all leukemic cells, S1 most immature blast population, S3 most mature blast population and S2 median mature blast population. All nodes: AUC ≧0.7, p values ≦0.05, lowest N=4 

 
     Example 4 
     Multi-parameter flow cytometric analysis was performed on BMMC samples taken at diagnosis from 61 AML patients. The samples were balanced for complete response (CR) and non-responders (NR) after 1 to 3 cycles of induction therapy and de novo versus secondary AML. Nodes in Tables 2 to 10 were examined. 
     10 nodes are common in stratifying NR and CR between the studies in Example 2 and these studies. Table 14 shows the common stratifying nodes. 
     
       
         
           
               
             
               
                 TABLE 14 
               
               
                   
               
             
            
               
                 Cytokine Pathways: 5 Nodes 
               
            
           
           
               
               
               
            
               
                   
                 IL-27 
                 p-Stat 3 and p-Stat 1 
               
               
                   
                 IL-27 
                 p-Stat 1 
               
               
                   
                 IL-6 
                 p-Stat 3 
               
               
                   
                 IL-10 
                 p-Stat 3 
               
               
                   
                 IFNa 
                 p-Stat 1 
               
            
           
           
               
            
               
                 Growth Factor: 4 Nodes 
               
            
           
           
               
               
               
            
               
                   
                 Flt3L 
                 p-Akt and p-S6 
               
               
                   
                 SCF 
                 p-Akt and p-S6 
               
            
           
           
               
            
               
                 Apoptosis Pathway 
               
            
           
           
               
               
               
            
               
                   
                 Etoposide or AraC/Dauno 
                 Cleaved PARP +   
               
               
                   
                   
               
            
           
         
       
     
     In secondary analysis patient subpopulations were stratified by clinical variables. Patients are stratified by age, de novo acute myeloid leukemia patient, secondary acute myeloid leukemia patient, or a biochemical/molecular marker. 
     Patients were stratified by age (as split variable &lt;60 years old vs. &gt;60 years old and as covariate). In patients younger than 60 years old, NRs have higher H 2 O 2  and FLT3L responses than CRs. In patients younger than 60 years old, NRs have higher IL-27 response than CRs. In addition, in patients younger than 60 years old, CRs induce apoptosis to Etoposide or Ara-C/Daunorubicin more than NRs. 
     Patients were stratified by de novo versus secondary AML. Stratifying nodes for de novo group show overlapping nodes with patients younger than 60 year old. Stratifying nodes for secondary group show overlapping nodes with patients older than 60 year old group. 
     Patients were stratified by FLT3 ITD mutation vs. FLT3 wild type phenotypes. The signaling was significantly different between the patients with FLT3 ITD mutation vs. FLT3 wild type. Parp-cytosine.b.arabino.furanoside is an example of an identified node informative on relapse risk in patients who achieved CR and have FLT3 WT and normal karyotype disease (not shown). 
     Individual nodes can be combined for analysis. Several methods can be used for the analysis. 
     The nodes can be analyzed using additive linear models to discover combinations that provide better accuracy of prediction for response to induction therapy than the individual nodes. These models can also include clinical covariates like age, gender, secondary AML that may already be predictive of the outcome. Only nodes that add to the accuracy of the model after accounting for these clinical covariates are considered to be useful. The formula below is an example of how additive linear models can be used 
       Response (CR or NR)= a+b*C   1   +c*C   2   +d *Node 1   +e *Node 2    
     C1 and C2 are the clinical covariates that are considered to be predictive of response, Node1 and Node2 are the two nodes from the biological data. The coefficient a, b, c, d, e are determined by the regression process. The significance of the coefficients if tested against them being equal to zero; i.e. if the p-value for d=0 if very small (say &lt;0.05), then the contribution from the Node1   is considered to the important. Several such models can be explored to find combinations of nodes that are complimentary. Examples of methods for exploring multiple such models include bootstrapping, and stepwise regression. 
     Analysis methods can include additive lineal models, such as the model represented in the following equations 
       CR or NR= a+b *Age(categorical)+ c *Node for “all blast” population
 
     Incorporating age as a clinical variable increases the significance of the resulting combination model (not shown). 
     The nodes can be analyzed using independent combinations of nodes. This method seeks threshold along different node axes independently. This model among clinical sub-groups improves predictive value (not shown). 
     The nodes can be analyzed using decision trees model. This model involves the hierarchical splitting of data. This model might mimic a more natural decision process. Each node is evaluated on sub-set of data at each level of the tree. 
     Both independent node combinations and decision tree provide node combinations of interest. 
     Results from the BMMC samples were compared with PBMC samples from the same patients in 10 of the patients. The samples were compared for sub-populations and signaling. The same phenotypic sub-populations are present in PBMC and BMMC, but in different percentage. It was observed that ⅔ of nodes correlate (i.e. Pearson &gt;0.8 or Spearman &gt;0.8) in “all blast” population of PBMC vs. BMMC. The correlations are node and subpopulation specific. 
     Example 5 
     This example evaluated whether single cell network profiling (SCNP), in which cells are modulated and their signaling response ascertained by multiparametric flow cytometry, could be used to functionally characterize signaling pathways associated with in vivo AML chemotherapy resistance. Morphologic and functional heterogeneity of myeloblasts was observed in paired samples obtained from two patients at diagnosis and at first relapse. Notably, a subpopulation of leukemic cells characterized by simultaneous SCF-mediated increases in the levels of phosphorylated (p-) Akt and p-S6 (SCF:p-Akt/p-S6), was identified in the relapsed samples from both patients. This SCF responsive subpopulation, although dominant in the relapse samples, was present and detectable at a much lower frequency in the diagnostic samples. Application of this finding to an independent set of 47 AML diagnostic samples identified seven patients, six of whom experienced disease relapse. The presence of an SCF:pAkt/p-S6 subpopulation was independent from c-Kit (SCF receptor) expression levels on the AML blasts and from patient age, cytogenetics and FLT-3 mutational status. This example shows that longitudinal SCNP analysis can provide unique insights into the nature of AML chemoresistance allowing for the identification of subpopulations of cells present at diagnosis with unique signaling characteristics predictive of higher rates of relapse. 
     Materials and Methods 
     Patient Samples 
     All AML bone marrow mononuclear cells (BMMC) were derived from the bone marrow (BM) of AML patients treated at MD Anderson Cancer Center (MDACC) between September 1999 and September 2006. Clinical data were de-identified in compliance with Health Insurance Portability and Accountability Act regulations. Patient/sample inclusion criteria required a diagnosis of French-American-British (FAB) classification of M0 through M7 AML (excluding M3) AML, collection prior to therapy initiation and at least 50% viability upon sample thaw. For the identification of chemoresistant signaling profiles, two longitudinally paired BMMC samples at diagnosis (collection prior to the initiation of induction chemotherapy) and first relapse, were examined. An independent test set comprised of 47 BMMC samples collected at diagnosis from AML patients with a disease response of CR after high dose cytarabine based chemotherapy was used to assess the ability of the identified signaling profiles to predict disease relapse. Healthy, unstimulated BMMC (n=2) were purchased from a commercial source (All Cells) to serve as a control. All samples underwent fractionation over Ficoll-Hypaque prior to cryopreservation with 90% fetal bovine serum and 10% dimethyl sulfoxide and storage in liquid nitrogen. 
     SCNP Assay 
     The SCNP assay measured response to growth factors and cytokines involved in hematopoietic progenitor or myeloid biology (SCF, FLT3L, G-CSF, IL-27), drug transporter (ABCG2, MRP-1) and chemokine receptors (CXCR4) associated with adverse disease prognosis in AML, and the c-Kit growth factor receptor for SCF. The SCF and FLT3L-mediated PI3K/Akt and MAPK pathway is important for maintaining the hematopoietic stem cell pool; G-CSF-mediated Jak/STAT pathway activation is important for neutrophilic differentiation of hematopoietic progenitor cells; interleukin (IL)-27 mediated Jak/STAT pathway activation is important in regulating proliferation and differentiation of hematopoietic stem cells; CXCR4 expression is associated with disease relapse and decreased survival; and drug transporter expression levels (i.e. ABCG2 and MRP-1) are known to be associated with adverse prognosis in AML. All together, approximately 20 signaling nodes were evaluated in each sample. 
     SCNP assays were performed as described previously. Cryopreserved samples were thawed at 37° C. and washed once in warm PBS containing 10% FBS (HyClone, Waltham, Mass., USA) and 2 mM EDTA. The cells were re-suspended, filtered to remove debris and washed in RPMI 1640 (MediaTech, Manassas, Va., USA) cell culture media containing 1% FBS before staining with Aqua LIVE/DEAD viability dye (Invitrogen, Carlsbad, Calif., USA) to distinguish non-viable cells. The cells were re-suspended in RPMI containing 1% FBS, aliquoted to 100,000 cells/condition and rested for 1-2 hours at 37° C. Cells were incubated for 15 minutes at 37° C. with each of the following signaling modulators: fms-like tyrosine kinase receptor-3 ligand (FLT3L, 50 ng/ml; eBiosciences, San Diego, Calif., USA); granulocyte colony-stimulating factor (G-CSF, 50 ng/ml; R&amp;D Systems, Minneapolis, Minn., USA); interleukin-27 (IL-27, 50 ng/ml, R&amp;D Systems); stem cell factor (SCF, 20 ng/ml, R&amp;D Systems). After exposure to modulators, cells were fixed with a final concentration of 1.6% paraformaldehyde (Electron Microscopy Sciences, Hatfield, Pa., USA) for 10 minutes at 37° C. Cells were pelleted and then permeabilized with 100% ice-cold methanol (Sigma-Aldrich, St. Louis, Mo., USA) and stored at −80° C. overnight. Subsequently, cells were washed with FACS buffer containing phosphate buffered saline (PBS, Fisher Scientific, Waltham, Mass., USA), 0.5% bovine serum albumin (BSA, Ankeny, Iowa, USA), 0.05% NaN3 (Mallinckrodt, Hazelwood, M0, USA), pelleted and stained with cocktails of fluorochrome-conjugated antibodies. As an exploratory effort, when sufficient number of cells were available, simultaneous measurement of c-Kit expression and SCF induced signaling was also performed. Antibodies were available from commercial vendors such as BD, Bechman Coulter, Invitrogen and R&amp;D Systems. 
     Flow Cytometry Data Acquisition and Analysis 
     Flow cytometry data was acquired on an LSR II and/or CANTO II flow cytometer using the FACS DIVA software (BD Biosciences, San Jose, Calif.). All flow cytometry data were gated using either FlowJo (TreeStar Software, Ashland, Oreg.), or WinList (Verity House Software, Topsham, Me.). 3D Visual analysis was performed using Spotfire (Tibco, Somerville, Mass., USA). Dead cells and debris were excluded by forward scatter, side scatter, and Aqua viability dye staining. Surface markers consisting of CD45, CD34, CD11b and CD33 and right-angle light-scatter characteristics identified phenotypes consistent with myeloid leukemia cells. The percentage of cells expressing c-Kit was calculated by the frequency of cells with an intensity level greater than the 95th percentile for isotype control antibody staining. CXCR4, MRP-1, and ABCG2 expression levels were calculated as a fold difference compared to the mean fluorescent intensity value obtained by the corresponding isotype control antibody. 
     Gating applied to the second data set to assay SCF, FLT3L, G-CSF, and IL-27 responsiveness was defined by the basal state (unstimulated) fluorescence of downstream readouts (e.g. p-Akt, p-S6, STAT3). This gating was performed on healthy BM samples which were run in each study as controls since absolute values were not comparable between the studies due to differences in experimental configurations (e.g. reagent and cytometer calibrations). The choice of normal BM to define the cut off for the activated subpopulation in AML marrow was based on the potential for constitutively activated pathways in AML samples. 
     Statistical Analysis 
     Given the relatively small number of samples, comparisons between the readouts from diagnostic and relapse samples were performed visually. After resistance-associated nodes were identified, Fisher&#39;s exact test was applied to compute the probability of association of the nodes with disease relapse occurring by chance in an independent data set. R statistics package was used for this purpose. 
     Results 
     Patient and Sample Characteristics 
     Modulated SCNP was evaluated on longitudinally paired diagnosis and relapse AML samples from two patients with AML. Clinical characteristics of the patients are shown in Table 15. Both patients received high dose cytarabine based induction chemotherapy with disease response of CR followed by relapse within one year. Cytogenetic analysis revealed prognostically unfavorable translocations of AML1-EVI1 and DEK-NUP214 [t(6;9)] in patients one and two respectively. In addition, patient two had FLT3-ITD positive leukemia, a known poor prognostic marker for relapse risk and overall survival and associated with the DEK-NUP214 translocation in the majority of cases. 
     Healthy control BMMC (N=2) were derived from young healthy male volunteers (age=18 and 20 years respectively). 
     
       
         
           
               
             
               
                 TABLE 15 
               
             
            
               
                   
               
               
                 Clinical Characteristics of Patient Donors for Longitudinally Paired Diagnosis and Relapse Samples 
               
            
           
           
               
               
               
               
               
               
               
               
               
               
               
               
               
            
               
                   
                   
                   
                   
                   
                   
                   
                   
                   
                   
                   
                   
                 CR 
               
               
                   
                 Age 
                   
                 Sample 
                 Secondary 
                   
                   
                 Cytogenetic 
                 FLT3 
                 Induction 
                 Induction 
                 Re- 
                 Duration 
               
               
                 Donor 
                 (Years) 
                 Gender 
                 Source 
                 AML 
                 FAB 
                 Cytogenetics 
                 Group 
                 ITD 
                 Chemotherapy 
                 Response 
                 lapse 
                 (Weeks) 
               
               
                   
               
            
           
           
               
               
               
               
               
               
               
               
               
               
               
               
               
            
               
                 1 
                 77.8 
                 M 
                 BM 
                 No 
                 M0 
                 46, XY,  
                 unfavorable 
                 NEG 
                 IDA + HDAC* 
                 CR 
                 Yes 
                 46.143 
               
               
                   
                   
                   
                   
                   
                   
                 t(3; 21) 
                   
                   
                   
                   
                   
                   
               
               
                   
                   
                   
                   
                   
                   
                 (q26; q22) 
                   
                   
                   
                   
                   
                   
               
               
                 2 
                 34.8 
                 F 
                 BM 
                 No 
                 M2 
                 t(6; 9)  
                 unfavorable 
                 POS 
                 IA +  
                 CR 
                 Yes 
                 11.143 
               
               
                   
                   
                   
                   
                   
                   
                   
                   
                   
                 ZARNESTRA** 
               
               
                   
               
               
                 *Idarubicin + high dose Ara-C 
               
               
                 **Idarubicin + Ara-C + Zarnestra 
               
            
           
         
       
     
     Comparison of Diagnosis and Relapse AML Samples 
     Longitudinally paired diagnostic and relapse samples from two AML patients were processed as described in Materials and Methods to assess whether specific cell subpopulations could be identified (using cell surface phenotypes and/or signaling profiles) in the relapsed sample in a greater percentage than observed in the corresponding diagnostic sample. Next, in an independent and larger group of diagnostic patient samples, the presence of blasts with the previously identified cell profiles were examined for their association with disease relapse. 
     Myeloblast Subpopulations Defined by Surface Markers 
     The two diagnostic and first relapse samples were first compared for expression of conventional surface markers used to define myeloblast maturity as shown in  FIG. 5 (panel a). Samples from both patients displayed different proportions of CD34+ CD11b− (immature), CD33+ CD11b+(mature) and all other blasts (intermediate-neither mature nor immature) phenotypes from each other and between diagnosis and relapse. Subpopulations based on these characteristics of myeloblast maturity were not informative of relapse risk for either patient sample ( FIG. 5  (panel b)). The levels of the chemokine receptor CXCR4 and drug transporters ABCG2 and MRP-1 were similar between diagnosis and relapse samples and were also not informative for disease relapse (not shown). 
     Myeloblast Subpopulations Defined by Intracellular Signaling Profiles 
     Examination of intracellular signaling profiles revealed functionally distinct cell subsets in the otherwise phenotypically similar relapse and diagnosis samples ( FIG. 6 ). Specifically, when the relapse samples from Patient 1 and Patient 2 were modulated using SCF, both p-Akt and p-S6 were induced in 3.2% and 31.7% of cells respectively ( FIG. 6 ). A similar finding of an increased percentage of myeloblasts subpopulations defined by intracellular signaling profiles in relapse versus diagnosis samples was observed when FLT3L (inducing p-S6 and p-Akt,  FIG. 6 ), and IL-27 or G-SCF (inducing p-STAT3 and p-STAT5) were used as modulators (not shown). 
     To investigate whether similar cells were present at the time of diagnosis, which would support the concept of selection, or absent, supporting the idea of an induced change, we looked for the presence of cells with similar functional responses to SCF, FLT3L, IL-27 and G-CSF in the corresponding diagnosis samples. While no IL-27 responsive subpopulation was identified, SCF, FLT3L and G-CSF responsive cells were observed in the diagnostic AML bone marrow samples ( FIG. 6 ), although in much lower percentage (˜1%). Back-gating of the SCF responsive cells in the relapse samples revealed that the SCF:p-Akt/p-S6 signaling profile was found in phenotypically diverse cell subpopulations despite similar categorization by conventional surface markers (not shown, CD34+ CD33+ CD1 b− for both Patient 1 and Patient 2 yet each patient displays distinct SCF-responsive cell subpopulation). In the two normal BM samples, an SCF-responsive subpopulation was present and was comparable between the samples; These SCF responsive cells were phenotypically distinct from the SCF-responsive cellsin the leukemia samples and characterized by CD34+ CD33− CD11b− (not shown). 
     Testing the Predictive Value at Diagnosis for Disease Relapse of Resistance-Associated Signaling Nodes 
     After identifying the resistance-associated signaling nodes in the relapsed samples, we analyzed the nodes in the valuer for being predictive for poor outcome [early relapse]. 
     Predictive Value of SCF:p-Akt/p-S6 Subpopulation in an Independent Sample Set 
     We first applied the SCF:p-Akt/p-S6 gating scheme (as defined in Materials and Methods) to an independent set of diagnostic AML samples. All patients received high dose cytarabine based induction chemotherapy with disease response of complete remission. Of these, 27 experienced disease relapse (CR Rel) while 20 remained in complete continuous remission (CCR) for two or more years. Patients from whom this independent sample set was obtained were young (41/47&lt;60) and a high proportion (20/47) had FAB M2 AML. 
     In seven diagnostic AML samples a subset of leukemic blast cells, which responded to SCF modulation by phosphorylation of p-Akt and p-S6, were observed (not shown). Of those seven, six patients experienced disease relapse within two years (p=0.21, Fisher&#39;s exact test) from remission while the seventh patient had a complete remission lasting more than two years; interestingly this AML sample had favorable cytogenetics t(8;21) (not shown). Of note, all of the patients with this SCF responsive profile were less than 60 years old and with the exception mentioned above, they all had intermediate or high risk cytogenetics; six out of seven also had an early myeloid FAB classification of M1 or M2. Also of note, the occurrence of the SCF:pAkt/pS6 subpopulation was independent of the presence of FLT3-ITD: only one of the six samples was positive for FLT3-ITD mutation. Importantly, the predictive value of the combination of FLT3-ITD and SCF:p-Akt/p-S6 for disease relapse was greater than either biomarker individually (p=0.03, Fisher&#39;s Exact Test). 
     c-Kit (SCF Receptor) Expression is not Predictive of SCF Responsiveness 
     We next examined whether expression of c-Kit, the receptor for SCF, could function as a surrogate marker for the SCF:p-Akt/p-S6 phenotype. Although only samples that expressed c-Kit were able to respond to SCF, no association between c-Kit expression levels and likelihood of leukemia relapse ( FIG. 7 a   ) was observed suggesting that c-Kit expression is a necessary but not sufficient condition for intra-cellular signaling. In line with this observation, the removal of non-c-Kit expressing samples improved relapse prediction ( FIG. 7 b   ). Furthermore, when blast cells from an AML sample were simultaneously examined for c-Kit and the downstream signaling marker p-Akt, intra-patient heterogeneity in c-Kit expression and response to SCF within c-kit expressing cells was observed ( FIG. 7 c   ). 
     Predictive Value of Other Resistance-Associated Signaling Node Subpopulations in an Independent Sample Set 
     We also examined whether FLT3L:p-Akt/p-S6, G-CSF:p-STAT3/5 or IL-27:p-STAT3/5 signaling nodes predicted poor outcome in the same independent set of diagnostic AML samples. Unlike SCF: p-Akt/p-S6 gate, no association was found with disease relapse (not shown). 
     DISCUSSION 
     Relapse due to chemoresistant residual disease is a major cause of death in both adult and pediatric patients with AML and aberrant signal transduction within pathways that control cell proliferation and survival is thought to play an important role in secondary chemoresistance. In this study we used SCNP as a strategy to identify specific signaling pathway profiles associated with in vivo chemoresistance using paired diagnosis and relapse samples. While performed on a limited number of paired AML samples, our study provides unique insights into the nature of AML secondary chemoresistance in rare cell populations, identifying a functionally characterized cell subset associated with likelihood of early relapse when the assay was applied in a separate patient cohort. 
     A subset of leukemia cells with enhanced activity within the PI3 kinase/Akt cascade (SCF:p-Akt/p-S6) was found to be commonly expanded in the two leukemia samples collected at relapse. Importantly, the presence of cell subpopulations expressing this same signaling profile at diagnosis was associated with disease relapse after complete response to induction chemotherapy in an independent sample set of AML diagnostic samples. Although the SCF:p-Akt/p-S6 profile was not present in all patients with relapsed disease, all but one sample that contained a subpopulation of &gt;3% SCF:p-Akt/p-S6 cells relapsed within two years of remission. These data support the marked biologic heterogeneity at the basis of AML secondary chemoresistance and lend merit to the approach of studying signaling profiles in functionally distinct subpopulations in longitudinally collected AML samples before and after therapy to identify poor-prognostic cell populations. While the SCF:p-Akt/p-S6 profile was predictive for relapse, other profiles (i.e. G-CSF:p-STAT 3/5, FLT3L:p-Akt/p-S6 and IL-27:p-STAT 3/5) were not associated with poor outcome in this sample set. Whether these nodes have clinical significance remains to be determined. Analysis of additional paired samples is likely to reveal other pathway nodes predictive of chemoresistance or relapse. The data also supports the concept that the cells that give rise to resistance are selected from amongst the diversity of leukemic blasts present at diagnosis, as opposed to induction of cells with new characteristics. This implies that recognition of resistance prone characteristics at diagnosis could be used to select and apply therapies that target these cells mechanistically on an individualized basis at the time of diagnosis. Thus, the results described herein could be used to prevent chemoresistance from emerging and improve clinical outcome. 
     PI3K/Akt signaling is known to play a fundamental role in opposing apoptosis and has been shown to be associated with resistance to a variety of chemotherapeutic agents, including those used to induce remission in AML and with inferior survival in AML. Importantly, the prognostic value of the presence of the SCF:p-Akt/p-S6 profile was independent from other known prognostic factors for relapse in AML including age and the presence of FLT3 ITD mutation. In the tested sample set the combination of the SCF:p-Akt/p-S6 phenotype with FLT-3 ITD mutational status resulted in higher predictive value for disease relapse than that either marker alone. Further studies are warranted to determine whether these findings, including the significance of this phenotype occurring predominantly in early myeloid (FAB M1-M2) leukemia, hold true in larger independent sample sets. 
     The receptor tyrosine kinase Kit and its ligand SCF are expressed on early hematopoietic cells and are essential for the proliferation and survival of these cells. (34) Kit is expressed on over 70% of pediatric and adult AML and activating mutations of c-Kit are associated with poor outcome in the core binding factor subset of adult AML. While this study did not examine molecular aberrations aside from FLT-3 mutational status, we show that c-Kit expression could not substitute for the poor prognostic SCF:p-Akt/p-S6 phenotype. In addition, heterogeneity of c-Kit was observed within individual leukemia samples with some blast subpopulations expressing high levels and other populations showing no cell surface c-Kit expression. Furthermore, the simultaneous examination of c-Kit and p-Akt revealed distinct c-Kit positive cell populations within an individual AML sample that had different signaling capabilities. This strategy will provide the ability to examine signaling in future studies only in the cells that express c-Kit. Taken together, these data reveal the diversity of c-Kit expression and function in the context of AML, underscore the complexity and heterogeneity of each individual&#39;s AML, and suggest further studies incorporating dual cell surface and intracellular profiling. 
     Currently there are no measures to indicate why patients with similar clinically appearing disease have different responses to therapy with some remaining disease free while others undergo disease relapse and ultimately succumb. SCNP permits an accurate characterization of each individual&#39;s leukemia signaling pathway phenotype and biologic heterogeneity allowing for a more efficient delineation of the normality or pathology of leukemic subpopulations. This study shows that leukemic cell populations differ quantitatively and qualitatively before and after in-vivo therapeutic pressure in AML and that SCNP offers a novel approach to identify chemotherapy-resistant subpopulations that may predispose patients to disease relapse. 
     Example 6 
     a. Exposure of AML Blasts In Vitro to Staurosporine and Etoposide Reveals Three Distinct Apoptosis Profiles 
     Jak/Stat and PI3 kinase pathways are tied to cancer cell survival. For this reason, apoptotic proficiency in AML samples was determined in response to etoposide and staurosporine exposure in vitro. In addition, the ability of etoposide and staurosporine to induce a DNA damage response was also evaluated for these samples. 
     Single cell network profiling using flow cytometry was used to determine DNA damage response and apoptosis in AML blasts after in vitro exposure to staurosporine and etoposide. After treatment of samples with staurosporine for 6 h or etoposide for 24 hours, cells were stained with Amine Aqua viability dye then fixed, permeabilized and incubated with a cocktail of fluorochrome-conjugated antibodies that delineated AML blasts by their surface markers and measured levels of intracellular signaling molecules within the canonical intrinsic apoptosis pathway: cleavage products of Caspase 3, Caspase-8, and PARP. 
     The data showed three distinct apoptosis responses of AML blasts after in vitro exposure to staurosporine and etoposide (not shown). The metric used to analyze this data was “Apoptosis” and is a measure of apoptosis and cell death induced by a drug. A viable cell will be Aqua negative and PARP negative and a measure of cell death is PARP and/or Aqua positivity. 
       “Apoptosis”=% of PARP −  Aqua −   unstim −% of PARP −  Aqua −   Drug .
 
     If initially before exposure to a drug a sample has 80% of cells that are PARP −  Aqua −  (live/healthy) and after treatment the sample has 30% of cells that are PARP −  Aqua −  then the drug induced an apoptotic response in 50% of the cells. 
     In the first profile, staurosporine, a multi-kinase inhibitor and inducer of apoptosis, failed to induce apoptosis (Staurosporine Resistant profile). Samples responsive to staurosporine were then classified by their responses to Etoposide, a topoisomerase 11 inhibitor which identified a second signature in which AML blasts were competent to undergo an apoptotic response to staurosporine but not to etoposide (Etoposide Resistant Profile). The third profile described AML blasts that were competent to undergo apoptosis in response to both agents (Apoptosis Competent Profile). 
     Co-incubation of samples with a pan-Caspase inhibitor, Z-VAD, revealed different apoptotic mechanisms among leukemic samples. Various changes in the levels of Cleaved Caspase-3 and PARP were observed upon co-incubation with Z-VAD revealing contributions of both caspase-dependent (Z-VAD sensitive) and caspase-independent (Z-VAD insensitive) pathways of apoptosis, (not shown). For example, Z-VAD inhibited cleavage of caspase 3 and PARP to near completion (0341, 0521) suggesting that in these samples apoptosis was predominantly caspase-dependent. In other samples (8303, 8402) PARP cleavage was only partially inhibited by Z-VAD treatment suggesting the presence of caspase-independent mechanisms of apoptosis. Samples that were classified by the “Apoptosis Competent profile” were enriched for Z-VAD in sensitive samples, suggesting the presence of both caspase dependent and independent cell death pathways in these samples suggesting that in these samples cells have a choice of cell death pathways (not shown). 
     Mechanistically, treatment of cells with etoposide (but not staurosporine) will result in DNA damage which will halt the cell cycle through activation of cell cycle checkpoint kinases and give the cell time to repair the damage. If attempts to repair DNA are unsuccessful, cells undergo apoptosis (Huang et al., Molecular Cancer therapeutics 2008 and see references therein). In this study DNA damage was determined by measuring the ATM phosphorylation site, T68, on Chk2. In this AML sample set different DNA Damage and Apoptosis in responses were seen between samples exposed in vitro to Etoposide. The spectrum of responses included samples which failed to elicit a DNA damage and apoptosis response (8314), samples in which there was a DNA damage response but no apoptosis (0521, 8390) and samples in which both responses were intact (5688, 8303, 8402). Analysis of the in vitro apoptotic responses in the context of FLT3 mutations revealed a range of apoptosis responses in both molecular classes. Notably, samples in which staurosporine and etoposide induced the greatest apoptotic responses were those that expressed FLT3 ITD. As discussed above, given the range of signaling responses within a molecularly classified group, in this case FLT3 ITD mutations, further analysis of networks should be performed to characterize samples and classify patients and their potential response to therapeutic agents. 
     The apoptosis profile revealed for each AML sample after in vitro exposure to staurosporine and etoposide was compared to the clinical response documented post induction therapy. Strikingly, the “Staurosporine Resistant” and “Etoposide Resistant” apoptosis profiles were completely comprised of AML samples from clinical NR patient samples. In contrast, the “Apoptosis Competent” profile comprised all samples from clinical CR patients. Of note, several samples from NR patients fell into the Apoptosis CompetentProfile”. Thus, in vitro apoptosis assays in leukemic samples could potentially model in vivo clinical responsiveness to chemotherapy. 
     b. Jak/Stat and PI3K Signaling Confer Resistance to Apoptosis in AML Blasts 
     To understand how proliferation and survival signaling relate to apoptotic potential, JAK/STAT and PI3K/S6 pathway activity in leukemic samples was analyzed in the context of the apoptotic profiles described above. While some differences in the basal unstimulated levels of phosphorylated STAT proteins were observed between apoptotic signature groups, stimulation with cytokines revealed variable JAK/STAT activity among the apoptosis categories described above. Robust Jak/Stat responses were seen upon treatment with G-CSF (p-Stat3, p-Stat5) or GM-CSF (p-Stat5) in all samples from the “Staurosporine Resistant’ apoptosis category, consistent with Stat proteins providing a survival function. In the two other apoptotic categories, the G-CSF-mediated increases in p-Stat3 and p-Stat5 were variable suggesting that in these patients, G-CSF signaling provides an apoptosis-independent pathway for analysis and potential patient stratification. 
     Consistent with the role of augmented Stat signaling in “staurosporine resistant” samples, IL-27-induced levels of total p-Stat1 and p-Stat3 were all greater in this apoptotic sub-category. “Etoposide Resistant” samples had varying levels of IL-27-mediated Stat signaling and the lowest levels of induced Stat phosphorylation were observed in the “Apoptosis Competent” category (not shown). 
     The NR patients within the “apoptosis Competent” Profile displayed higher IL-27 induced p-Stat than CR patients again emphasizing the need to evaluate multiple pathways in patient samples in order to reach meaningful clinical decisions. 
     Consistent with their roles in survival, there was an inverse correlation between levels of growth factor-mediated-p-Akt and p-S6 signaling and apoptotic response. Greater induced p-Akt and p-S6 levels were observed in samples where there was a low level of induced apoptosis (Staurosporine and/or Etoposide Resistant categories). In contrast in the “Apoptosis Competent Profile” there were low levels of growth factor-mediated increases in p-Akt and p-S6 (not shown). 
     Other myeloid cytokines and chemokines known to stimulate the PI3K/S6 and pathway are G-CSF, GM-CSF, and SDF-1α. Overall, these modulators mediated the greatest increase in p-Akt and p-S6 levels in the “Staurosporine Resistant’ category consistent with the survival role conferred by the PI3K pathway. Notably, two different cytokines, G-CSF and GM-CSF provided a similar signaling output (p-Stat5, p-S6) in this apoptotic category. Pathway characterization of AML blasts highlights the different signaling mechanisms utilized to evade apoptosis (for example: sample 8093, NR, “Etoposide resistant”, induced Jak/Stat signaling elevated, sample 0521, NR, “Etoposide Resistant”, induced PI3K/S6 signaling elevated, sample 4353, NR, “Staurosporine Resistant”, induced Jak/Stat and PI3K/S6 pathways elevated 
     c. Analysis of Signaling and Apoptosis in the Context of FLT3 Mutations 
     Analysis of the in vitro apoptotic responses in the context of FLT3 mutations revealed that AML samples expressing FLT3 ITD have relatively intact apoptotic machinery compared with AML samples expressing wild type FLT3 (not shown). However, apoptosis responses to both staurosporine and etoposide varied between samples within FLT3 ITD+ or WT subgroups, demonstrating that molecular characterization alone is not sufficient to classify patients and their potential response to therapeutics. In other analyses FLT3-ITD patients had higher basal p-Stat5 and cytokine induced p-Stat5 levels than FLT3-WT patients although a large spread of responses was seen in either FLT3-ITD or FLT3-WT patients. Also, FLT3-ITD patients had lower basal and FLT3L induced p-S6 than FLT3-WT patients. Again a spread of responses was seen within FLT3 WT or FLT3-ITD subgroups demonstrating how single cell network profiling can further characterize samples within a molecularly-defined patient subgroup 
     Example 7 
     Scenarios of how this invention might be used to advance the diagnosis or prognosis of disease, or the ability to predict or assess response to therapy are outlined in the following two paragraphs. 
     A 49 year-old individual presents to their primary medical doctor with the chief complaint of fatigue and bruising. A complete blood count reveals increased white blood cells, decreased hemoglobin and hematocrit, low platelets and circulating blasts. A bone marrow aspirate is obtained and flow cytometry reveals an immature myeloid blast population. The patient is diagnosed with acute myeloid leukemia and the physician and patient must determine the best course of therapy. Using an embodiment of the present invention, the bone marrow or peripheral blood of the patient might be removed and modulators such as GMCSF or PMA added. Activatable elements such as p-Stat3, p-Stat5 and p-Akt might classify this patient as one of the 25% of patients diagnosed with AML less than 60 years old who will not benefit from cytarabine based induction therapy. This invention may also reveal signaling biology within this patient&#39;s blasts population that suggests to the physician that the patient should be treated with a DNA methyl transferase inhibitor. With this invention, the patient would then be spared the toxicities associated with cytarabine therapy and could be placed on a clinical trial where he would receive a therapy from which he would likely benefit. 
     A 52 year-old female presents to her primary medical doctor with the chief complaint of fatigue and bruising. A complete blood count reveals normal numbers of white blood cells, decreased hemoglobin and hematocrit, and low platelets. A bone marrow aspirate and biopsy is obtained and flow cytometry and histology reveals tri-lineage myelodysplasia. The patient is diagnosed with MDS. Using an embodiment of the present invention, the bone marrow or peripheral blood of the patient might be removed and modulators such as GMCSF or PMA added. Activatable elements such as STAT3, STAT5 and AKT might reveal that the biology associated with this patient&#39;s MDS is likely of auto-immune origin. The physician promptly places this patient on CSA and ATG. Within 6 weeks she shows complete normalization of her complete blood count. 
     Example 8 
     This example relates to the publication “Dynamic Single-Cell Network Profiles in Acute Myelogenous Leukemia Are Associated with Patient Response to Standard Induction Therapy”. Kornblau S M, Minden M D, Rosen D B, Putta S, Cohen A, Covey T, Spellmeyer D C, Fantl W J, Gayko U, Cesano A. Clinical Cancer Research. 2010 Jul. 15; 16(14): 3721-33 January 31. This publication is incorporate herein by reference in its entirety for all purposes. 
     Traditional prognostic markers in acute myeloid leukemia (AML) use static features present at diagnosis. This study reports measurements of single cell network profiling (SCNP) in response to external modulators as a new tool to recognize and interpret disease heterogeneity in the context of therapeutic applications. Intracellular signaling profiles from two sequential training cohorts of diagnostic non-M3 AML patient samples (n=34 and 88) showed high reproducibility (Pearson correlation coefficients ≧0.8). In the first training study univariate analysis identified multiple “nodes” (modulated readouts of proteins in signaling pathways) relevant to myeloid biology and correlated with disease response to conventional induction therapy (i.e. AUC of ROC ≧0.66; p&lt;0.05). Importantly combining independently predictive nodes improved disease response stratification (AUC of ROC up to 1.0). Extrapolation of the assay to a second independent set of samples revealed similar findings after accounting for clinical covariates. In particular, for patients &lt;60 years old, the presence of intact apoptotic pathways was associated with complete response (CR), while FLT3 ligand mediated increase in phospho (p)-Akt and p-Erk correlated to NRs in patients ≧60 years. Findings were independent of cytogenetic and FLT3 mutational status. These data support the value of SCNP in AML disease characterization and management. 
     INTRODUCTION 
     Acute Myeloid Leukemia (AML) displays biologic and clinical heterogeneity due to a complex range of cytogenetic and molecular aberrations resulting in downstream effects on gene expression, protein function and cell signal transduction pathways, ultimately affecting proliferation and cellular differentiation. While morphology and cytochemical stains historically have formed the basis for AML classification, and emerging technologies such as gene expression profiling, microRNA profiling, epigenetic profiling and more recently proteomic profiling have been used to elucidate the biologic heterogeneity of AML, and have provided useful insights into the disease biology and its correlation with clinical outcomes. While individual molecular changes have shown to be associated with disease-free and overall survival, only karyotype, high expression levels of the brain and acute leukemia cytoplasmic (BAALC), and meningioma 1 (MN 1) genes at presentation have demonstrated an association with response to induction chemotherapy. (Marcucci et al. Curr Opin Hematol. 2005; 12:68-75; Langer C, Marcucci et al. J Clin Oncol. 2009; 27:3198-3204.) However, although these findings offer directionally predictive information at a population level, no validated means currently exist to predict the disease response to standard AML induction chemotherapy at the individual patient level. 
     Recently, reverse-phase protein arrays (RPPA) generated proteomic profiles that characterized aberrantly regulated signaling networks in AML samples and were found to correlate with known morphologic features, cytogenetics and outcome. (Kornblau et al. Blood. 2009; 113:154-164.) Single cell network profiling (SCNP) using multiparametric flow cytometry is a newer approach for analyzing and interpreting protein expression and post-translational protein modifications under modulated conditions at the single cell level. This approach interrogates the physiology of signaling pathways by measuring network properties beyond those detected in resting cells (e.g. failure of a pathway to become activated, hyper/hyposensitivity of the pathway to physiologic stimulators, altered response kinetics and rewiring of canonical pathways), thus revealing otherwise unseen functional heterogeneity in apparently morphologically and molecularly homogeneous disease groups. When applied to pathways shown to be important in disease pathology, this method of mapping signaling networks has potential applications in the development of predictive/diagnostic tests for therapeutic response and for improved efficiency of drug development. (Irish et al. Cell. 2004; 118:217-228; Irish et al. Nat Rev Cancer. 2006; 6:146-155; Krutzik et al. Nat Methods. 2006; 3:361-368; and Sachs et al. Science. 2005; 308:523-529.) 
     To utilize modulated SCNP to reveal AML network biology as a guide for disease management, two independent sample sets from newly diagnosed adult patients with AML (non-M3) were tested sequentially. Since multiple signaling pathways may be dysregulated in AML and impact responsiveness to therapy, a wide range of pathways that regulate proliferation, survival, DNA damage, apoptosis and drug transport were evaluated in response to modulators important in myeloid biology. Analyses evaluated assay performance, identified a signaling profile associated with response to standard induction chemotherapy (first training study) and extrapolated the identified profile to a fully independent set of AML samples (second training study). The results of the two studies illustrate the value of quantitatively measuring single cell signaling networks under modulated conditions to stratify AML patients for outcome to standard induction chemotherapy. 
     Materials and Methods 
     Patient Samples 
     Two independent sets of cryopreserved samples were analyzed sequentially. The first set consisted of 35 peripheral blood mononuclear cell (PBMC) samples derived from AML patients. The second set consisted of 134 cryopreserved bone marrow mononuclear cell (BMMC) samples derived from AML patients. These samples were the same samples used in the previous examples. Sample inclusion criteria required collection prior to initiation of induction chemotherapy, AML classification by the French-American-British (FAB) criteria as M0 through M7 (excluding M3) and availability of clinical annotations. 
     In the first study, induction chemotherapy consisted of at least one cycle of standard cytarabine-based induction therapy (i.e. daunorubicin 60 mg/m 2 ×3 days, cytarabine 100-200 mg/m 2  continuous infusion×7 days); responses were measured after one cycle of induction therapy. In the second study, cytarabine (200 mg/m 2  to 3 g/m 2 ) was used in combination with an anthracycline (daunorubicin or idarubicin) or an additional anti-metabolite (e.g. fludarabine or troxacitabine), and sometimes, an experimental agent (Table 16). Responses in this set were measured after completion of induction therapy (&gt;90% after one cycle). Standard clinical and laboratory criteria were used for defining complete response (CR) in both studies. Leukemia samples obtained from patients who did not meet the criteria for CR or samples obtained from those who died during induction therapy were considered non-complete response (NR) for the primary analyses. Both studies had one patient that met all the criteria for a clinical CR, with the exception of platelet recovery. Classified as “CRp,” these samples were included in the CR group for all primary analysis. The univariate analyses were also repeated with the CRp patients classified into the NR sample group for sensitivity analysis. 
                     TABLE 16                  Demographic and Baseline Characteristics for Evaluable Patients/Samples in Both Studies                                                     CR    NR   All Pts    P    CR    NR    All Pts    P        Characteristic   No. 1   No. 1   No. 1   No. 1   No. 2   No. 2   No. 2   No. 2                                                                 N   9   25   34       57   31   88           Age (yr)   Median   57   47.4   49.1   0.084   51.2   61.6   55.2   0.004           Range   38.2-74.8   20.7-70.2   20.7-74.8       27.0-79.0   25.0-76.3   25.0-79.0           Age Group     &lt;60 yr   5 (56%)    20 (80%)    25 (74%)    0.201   51 (89%)   15 (48%)   66 (75%)   &lt;.001           &gt;=60 yr   4 (44%)    5 (20%)   9 (26%)        6 (11%)   16 (52%)   22 (25%)           Sex   F   7 (78%)    14 (56%)    21 (62%)    0.427   32 (56%)   16 (52%)   48 (55%)   0.823           M   2 (22%)    11 (44%)    13 (38%)        25 (44%)   15 (48%)   40 (45%)           Cytogentic   Favorable   0 (0%)    1 (4%)    1 (3%)    0.639    7 (12%)   0 (0%)   7 (8%)   0.004       Group   Intermediate   8 (89%)    18 (72%)    26 (76%)        29 (51%)    9 (29%)   38 (43%)               Unfavorable   0 (0%)    3 (12%)   3 (9%)        21 (37%)   22 (71%)   43 (49%)               Not Done   1 (11%)    3 (12%)   4 (12%)       0 (0%)   0 (0%)   0 (0%)           FAB   M0   0 (0%)    2 (8%)    2 (6%)    0.474   1 (2%)   1 (3%)   2 (2%)   0.794           M1   2 (22%)    2 (8%)    4 (12%)        8 (14%)   1 (3%)    9 (10%)               M2   1 (11%)    5 (20%)   6 (18%)       22 (39%)    4 (45%)   36 (41%)               M4   1 (11%)    7 (28%)   8 (24%)       14 (25%)    8 (26%)   22 (25%)               M5   3 (33%)    2 (8%)    5 (15%)        8 (14%)    4 (13%)   12 (14%)               M6   0 (0%)    0 (0%)    0 (0%)        2 (4%)   2 (6%)   4 (5%)               Other/   2 (22%)    7 (28%)   9 (27%)       2 (4%)   1 (3%)   3 (3%)               Unknown                                       Race   White   3 (33%)    17 (68%)    20 (59%)    0.201   15 (26%)   15 (48%)   30 (34%)   0.127           Asian   5 (56%)    5 (20%)   10 (29%)        1 (2%)   1 (3%)   2 (2%)               Other*   1 (11%)    2 (8%)    3 (9%)        10 (18%)   1 (3%)   11 (13%)               Unknown   0 (0%)    1 (4%)    1 (3%)        31 (54%)   14 (45%)   45 (51%)           FLT3-ITD   Negative   4 (44%)    14 (56%)    18 (53%)    0.641   44 (77%)   23 (74%)   67 (76%)   0.477           Positive   5 (56%)    10 (40%)    15 (44%)        11 (19%)    5 (16%)   16 (18%)               Unknown   0 (0%)    1 (4%)    1 (3%)        2 (4%)    3 (10%)   5 (3%)           Secondary   No   8 (89%)    25 (100%)   33 (97%)    0.265   47 (82%)   14 (45%)   61 (69%)   &lt;.001       AML   Yes   1 (11%)    0 (0%)    1 (3%)        10 (18%)   17 (55%)   27 (31%)           Poor   No   5 (56%)    18 (72%)    23 (68%)    0.425   22 (39%)    3 (10%)   25 (28%)   0.004       Prognosis †   Yes   4 (44%)    7 (28%)   11 (32%)        35 (61%)   28 (90%)   63 (72%)           Induction   Standard 3 + 7   9 (100%)   25 (100%)   34 (100%)   n/a   0 (0%)   0 (0%)   0 (0%)   0.222       Therapy   Fludarabine +    0 (0%)    0 (0%)    0 (0%)        11 (19%)   2 (6%)   13 (15%)               HDAC                                           IA + Zarnestra   0 (0%)    0 (0%)    0 (0%)        18 (32%)    9 (29%)   27 (31%)               IDA + HDAC   0 (0%)    0 (0%)    0 (0%)        17 (30%)    9 (29%)   26 (30%)               Other   0 (0%)    0 (0%)    0 (0%)        11 (19%)   11 (35%)   22 (25%)               *The “Other” values for race are based on Black and Hispanic sub groups       † Poor prognosis is defined as having one or more of the following high risk features: age ≧60 years, unfavorable cytogenetics, FLT3 ITD positive or secondary AML            
There are 25 primary refractory patients and 6 failed patients in Study No. 2. The two-sample t-test was used to compare mean ages of CR and NR patients. Fisher&#39;s Exact test was used to compare CR and NR patients with respect to categorical variables with two levels. The standard Chi-Square test was used to compare CR and NR patients with respect to categorical variables with three or more levels.
 
     SCNP Assays 
     Cocktails of fluorochrome-conjugated antibodies were used to measure phosphorylated intracellular signaling molecules, cell lineage markers, and drug transporters in AML cells. Measurements were taken at basal state and after extracellular modulation with growth factors or cytokines. 
     A pathway “node” ( FIG. 1 ) was defined as a combination of specific proteomic readout in the presence or absence of a specific modulator. Up to 147 nodes (including eight surface receptors and transporters) using 27 modulators were assessed in the two studies (Table 17). 
     Samples with 6.8 and 4.7 million cells were required to test all planned experimental nodes in the first and second studies, respectively. In both studies, evaluable samples were defined as those that yielded a minimum of 100,000 viable cells. In addition, 500 cells were required in the myeloid blast population for any condition to be included in analysis for a given sample. In the first set, 34 of 35 patients had evaluable samples, although some samples did not have enough cells for the testing of all planned nodes (Table 17). There were also two cryopreserved vials of each sample, allowing for assessment of assay reproducibility. In the second set, the number of viable cells recovered after thawing (median 1.1 million cells) was significantly less than expected and only 88 of the 134 samples were evaluable. 

 
     Metrics are Defined in Materials and Methods 
     Each modulator and read-out combination is a node. Unmodulated, basal levels were also measured. In #1, there were 18 basal, 121 modulated, and 8 surface markers for a total node count of 147. In #2, there were 16 basal, 69 modulated, and 5 surface markers for a total node count of 90.
 
Akt indicates protein kinase B; APC, allophyco-cyanin; Ara-C, cytarabine; ATP-binding cassette, subfamily G, member 2; BCL, CD, cluster of differentiation; c-, cleaved-; CCG, cytokine, chemokine, growth factor; C-kit, CD117; CREB, cAMP response element binding; CXCR, CXC chemokine receptor; EPO, erythropoietin; Erk, Extracellular signal-regulated kinase; FITC, fluorescein isothiocyanate; FLT3, fms-like tyrosine kinase; G-CSF, granulocyte colony stimulating factor; GM-CSF, granulocyte macrophage stimulating factor; H 2 O 2 , hydrogen peroxide; IFN, interferon; IGF, insulin-like growth factor; IL, interleukin; M-CSF, macrophage colony stimulating factor; MDR, p-glycoprotein; NFkB, Nuclear Factor-Kappa B; p-, phospho-; p38, map kinase family protein 38; PARP, Extracellular signal-regulated kinase; PE, phycoerythrin; Plcγ, phospholipase c-gamma; S6, ribosomal protein S6; SCF, stem cell factor; SDF, stromal cell derived factor; Stat, signal transducer and activator of transcription; Stauro, staurosporine; TNF, tumor necrosis factor; ZVAD, ZVAD-FMK caspase inhibitor.
 
     Cyropreserved samples were thawed at 37° C., washed and centrifuged in PBS, 10% FBS and 2 mM EDTA. The cells were re-suspended, filtered to remove debris and washed in RPMI cell culture media, 1% FBS, then stained with Live/Dead Fixable Aqua Viability Dye to distinguish non-viable cells. The cells were then re-suspended in RPMI, 1% FBS, aliquoted to 100,000 cells/condition and rested for 1-2 hours at 37° C. prior to SCNP assays. Each condition included two to five phenotypic markers for cell population gating (eg, CD45, CD33), up to three intracellular stains or up to three additional surface markers or control antibodies for an eight-color flow cytometry assay. 
     Functional assays were performed as previously described. See Irish, et al., Cell 2004; 118:217-228. Cells were incubated with modulators (Table 18A), at 37° C. for 3-15 minutes, fixed with 1.6% paraformaldehyde (final concentration) for 10 minutes at 37° C., pelleted and permeabilized with 100% ice-cold methanol and stored at −80° C. For functional apoptosis assays, cells were incubated for 24 hours with cytotoxic drugs (i.e. etoposide or Ara-C and daunorubicin), re-stained with Live/Dead Fixable Aqua Viability Dye before fixation and permeabilization, washed with FACS Buffer (PBS, 0.5% BSA, 0.05% NaN 3 ), pelleted and stained with fluorescent dye-conjugated antibodies to both surface antigens (CD33, CD45) and the signaling protein targets (Table 18B). 
     
       
         
           
               
             
               
                 TABLE 18A 
               
             
            
               
                   
               
               
                 List of Modulators and Technical Conditions of Use in Both Studies 
               
            
           
           
               
               
               
               
               
            
               
                   
                   
                   
                 Modulator 
                   
               
            
           
           
               
               
               
               
            
               
                   
                 Final 
                 Treatment 
                   
               
               
                 Modulator 
                 Concentration 
                 Duration 
                 Manufacturer (Location) 
               
               
                   
               
            
           
           
               
               
               
               
               
            
               
                 Ara-C 
                 0.5  
                 ug/mL 
                 24 h 
                 Sigma Aldrich  
               
               
                   
                   
                   
                   
                 (St Louis, MO) 
               
               
                 CD40L 
                 0.5  
                 ug/mL 
                 7.5′ and 15′ 
                 R&amp;D (Minneapolis, MN) 
               
               
                 Daunorubicin 
                 100  
                 ng/mL 
                 24 h 
                 Sigma Aldrich  
               
               
                   
                   
                   
                   
                 (St Louis, MO) 
               
               
                 Erythropoetin 
                 1  
                 IU/mL 
                 15′ 
                 R&amp;D (Minneapolis, MN) 
               
               
                 Etoposide 
                 30 
                 mg/mL 
                 24 h 
                 Sigma Aldrich  
               
               
                   
                   
                   
                   
                 (St Louis, MO) 
               
            
           
           
               
               
               
               
            
               
                 FCS 
                 1.0% 
                 various 
                 HyClone (Waltham, MA) 
               
            
           
           
               
               
               
               
               
            
               
                 Flt3L 
                 50 
                 ng/mL 
                 15′ 
                 eBiosciences  
               
               
                   
                   
                   
                   
                 (San Diego, CA) 
               
               
                 G-CSF 
                 50 
                 ng/mL 
                 15′ 
                 R&amp;D (Minneapolis, MN) 
               
               
                 G-CSF 
                 50 
                 ng/mL 
                 15′ 
                 Pepro (Rocky Hill, NJ) 
               
               
                 GM-CSF 
                 2  
                 ng/mL 
                 15′ 
                 BD (San Jose, CA) 
               
               
                 H 2 O 2   
                 3 
                 mM 
                 15′ 
                 JT Baker (Phillipsburg, NJ) 
               
               
                 IFNα 
                 10000  
                 IU/ML 
                 15′ 
                 Schering (Kenilworth, NJ) 
               
               
                 IFNγ 
                 5 
                 ng/mL 
                 15′ 
                 BD (San Jose, CA) 
               
               
                 IGF-1 
                 6.66 
                 ng/mL 
                 15′ 
                 R&amp;D (Minneapolis, MN) 
               
               
                 IL-10 
                 25 
                 ng/mL 
                 15′ 
                 BD (San Jose, CA) 
               
               
                 IL-27 
                 50 
                 ng/mL 
                 15′ 
                 R&amp;D (Minneapolis, MN) 
               
               
                 IL-3 
                 50 
                 ng/mL 
                 15′ 
                 BD (San Jose, CA) 
               
               
                 IL-4 
                 5  
                 ng/mL 
                 15′ 
                 BD (San Jose, CA) 
               
               
                 IL-6 
                 25 
                 ng/mL 
                 15′ 
                 R&amp;D (Minneapolis, MN) 
               
               
                 LPS 
                 1  
                 ug/mL 
                 7.5′  
                 Sigma Aldrich  
               
               
                   
                   
                   
                   
                 (St Louis, MO) 
               
               
                 M-CSF 
                 2  
                 ng/mL 
                 15′ 
                 R&amp;D (Minneapolis, MN) 
               
               
                 PMA 
                 400 
                 nM 
                 15′ 
                 Sigma Aldrich  
               
               
                   
                   
                   
                   
                 (St Louis, MO) 
               
               
                 SCF 
                 20 
                 ng/mL 
                 15′ 
                 R&amp;D (Minneapolis, MN) 
               
               
                 SDF-1α 
                 2  
                 ng/mL 
                  3′ 
                 R&amp;D (Minneapolis, MN) 
               
               
                 Stauro 
                 2.33  
                 ug/mL 
                  6 h 
                 Sigma Aldrich  
               
               
                   
                   
                   
                   
                 (St Louis, MO) 
               
               
                 Thapsigargin 
                 1 
                 uM 
                 15′ 
                 EMD Biosciences  
               
               
                   
                   
                   
                   
                 (Darmstadt, Germany) 
               
               
                 TNFα 
                 20 
                 ng/mL 
                 7.5′  
                 BD (San Jose, CA) 
               
               
                 Z-VAD- 
                 100 
                 uM 
                 24 h 
                 R&amp;D (Minneapolis MN) 
               
               
                 FMK 
                   
                   
                   
                   
               
               
                 Caspase  
                   
                   
                   
                   
               
               
                 Inhibitor 
               
               
                   
               
            
           
         
       
     
     
       
         
           
               
             
               
                 TABLE 18B 
               
               
                   
               
               
                 Antibodies Used in Both Studies 
               
               
                   
               
             
            
               
                   
               
            
           
           
               
               
               
               
            
               
                   
                 Species &amp; 
                 Manufacturer 
                   
               
               
                 Antibody 
                 Isotype 
                 (Location) 
                 Label 
               
               
                   
               
               
                 ABCG2 
                 Mouse IgG2b 
                 R&amp;D (Minneapolis, MN 
                 APC 
               
               
                 BCL-2 
                 Mouse IgG1, k 
                 BD (San Jose, CA) 
                 FITC 
               
               
                 CD11b 
                 Mouse IgG1 
                 Beckman (Miami, FL) 
                 Pac Blue 
               
               
                 CD33 
                 Mouse IgG1 
                 Beekman (Miami, FL) 
                 Biotin 
               
               
                 CD33 
                 Mouse IgG1 
                 BD (San Jose, (A) 
                 Pac Blue 
               
               
                 CD34 
                 Mouse IgGI 
                 BD (San Jose, CA) 
                 PerCP 
               
               
                 CD40 
                 Mouse IgG1, k 
                 BD (San Jose, (A) 
                 APC 
               
               
                 CD45 
                 Mouse IgG1 
                 Invitrogen (Carlsbad, CA) 
                 Ax700 
               
               
                 C-Kit 
                 Mouse IgG1 
                 R&amp;D (Minneapolis, MN ) 
                 APC 
               
               
                 c-Caspase 3 
                 Rabbit IgG 
                 BD (San Jose, CA) 
                 FITC 
               
               
                 c-Caspase 8  
                 Rabbit IgG 
                 CST (Danvers, MA) 
                 Unlabeled 
               
               
                 (Asp391) 
                   
                   
                   
               
               
                 c-PARP(Asp214) 
                 Mouse IgG1, k 
                 BD (San Jose. CA) 
                 PE 
               
               
                 c-PARP(Asp214) 
                 Mouse IgG1, k 
                 BD (San Jose, CA) 
                 FITC 
               
               
                 Control Ig 
                 Ms IgG1 
                 eBio (San Diego, CA) 
                 FITC 
               
               
                 Control Ig 
                 Mouse IgG2a, k 
                 BD (San Jose, CA) 
                 PE 
               
               
                 Control Ig 
                 Rat IgG1 
                 MBL (Woburn, MA) 
                 FITC 
               
               
                 Control Ig 
                 Mouse IgG2b 
                 R&amp;D (Minneapolis, MN) 
                 APC 
               
               
                 Control Ig 
                 Mouse IgG1 
                 BD (San Jose, CA) 
                 PE 
               
               
                 Control Ig 
                 Mouse IgG1, k 
                 BD (San Jose, CA) 
                 FITC 
               
               
                 Control Ig 
                 Mouse IgG1, k 
                 BD (San Jose, CA) 
                 APC 
               
               
                 Control Ig 
                 Mouse IgG1, k 
                 BD (San Jose, CA) 
                 PE 
               
               
                 CXCR4 
                 Mouse IgG2a, k 
                 BD (San Jose, CA) 
                 PE 
               
               
                 CXCR4 
                 Rat IgG1 
                 MBL (Woburn, MA) 
                 FITC 
               
               
                 Cytochrome C 
                 Mouse IgG2b, k 
                 BD (San Jose, CA) 
                 Ax647 
               
               
                 EpoR 
                 Mouse IgG2b 
                 R&amp;D (Minneapolis, MN) 
                 FITC 
               
               
                 Flt3R 
                 Mouse igG1 
                 R&amp;D (Minneapolis, MN) 
                 PE 
               
               
                 Flt3R 
                 Mouse IgG1 
                 Ebio (San Diego, CA) 
                 FITC 
               
               
                 goat anti-rabbit 
                 Goat IgG 
                 Invitrogen (Carlsbad, CA) 
                 Ax488 
               
               
                 goat anti-rabbit 
                 Goat IgG 
                 Invitrogen (Carlsbad, CA) 
                 Ax647 
               
               
                 M-CSFR 
                 Mouse IgG1 
                 R&amp;D (Minneapolis, MN) 
                 FITC 
               
               
                 MRP-1 
                 Mouse IgG1 
                 R&amp;D (Minneapolis, MN) 
                 PE 
               
               
                 p-Akt (S473) 
                 Rabbit IgG 
                 CST (Danvers, MA) 
                 Ax647 
               
               
                 p-Akt (S473) 
                 Rabbit IgG 
                 CST (Danvers, MA) 
                 Ax488 
               
               
                 p-Chk2 (T68) 
                 Rabbit IgG 
                 CST (Danvers, MA) 
                 Unlabeled 
               
               
                 p-CREB (pS133) 
                 Rabbit IgG 
                 CST (Danvers, MA) 
                 Ax488 
               
               
                 p-CREB (pS133) 
                 Mouse IgG1, k 
                 BD (San Jose, CA) 
                 PE 
               
               
                 p-Erk 1/2  
                 Mouse IgG1 
                 BD (San Jose, CA) 
                 Ax647 
               
               
                 (T202/204) 
                   
                   
                   
               
               
                 p-Erk 1/2  
                 Mouse IgGI 
                 BD (San Jose, CA) 
                 PE 
               
               
                 (T202/204) 
                   
                   
                   
               
               
                 p-Lck (Y505) 
                 Mouse IgG1 
                 BD (San Jose, CA) 
                 Ax488 
               
               
                 p-NF-kB p65  
                 Mouse IgG2b, k 
                 13D (San Jose, CA) 
                 Ax647 
               
               
                 (pS529) 
                   
                   
                   
               
               
                 p-p38 MAPK  
                 Mouse IgG1 
                 BD (San Jose, CA) 
                 Ax488 
               
               
                 (pT180/pY182) 
                   
                   
                   
               
               
                 p-Plcγ2 (Y759) 
                 Mouse IgG1, k 
                 BD (San Jose, CA) 
                 PE 
               
               
                 p-Plcγ2 (Y759) 
                 Mouse IgG1, k 
                 BD (San Jose, CA) 
                 Ax488 
               
               
                 p-S6 (S235/236) 
                 Rabbit IgG 
                 CST (Danvers, MA) 
                 Ax488 
               
               
                 p-SLP76 (pY128) 
                 Mouse IgG1, k 
                 BD (San Jose, CA) 
                 Ax647 
               
               
                 p-Stat1 (pY701) 
                 Mouse IgG2a 
                 BD (San Jose, CA) 
                 Ax488 
               
               
                 p-Stat3 (pY705) 
                 Mouse IgG2a, k 
                 BD (San Jose, CA) 
                 PE 
               
               
                 p-Stat5 (pY694) 
                 Mouse IgG1 
                 BD (San Jose, CA) 
                 Ax647 
               
               
                 p-Stat6 (pY641) 
                 Mouse IgG2a 
                 BD (San Jose, CA) 
                 PE 
               
               
                 TNF-R1 
                 Mouse IgG2a 
                 Beckman (Miami, FL) 
                 PE 
               
               
                   
               
               
                 Non- 
                   
                   
                   
               
               
                 Antibody Stains 
                 n/a 
                 Manufacturer (Location) 
                 Dye 
               
               
                   
               
               
                 Amine Aqua  
                 n/a 
                 Invitrogen  
                 Aqua 
               
               
                 Viability Dye 
                   
                 (Carlsbad, CA) 
                   
               
               
                 Streptavidin-Qdot  
                 n/a 
                 Invitrogen  
                 Qdot 605 
               
               
                 605 
                   
                 (Carlsbad, CA) 
               
               
                   
               
               
                 Abbreviations are defined in Table 17 
               
            
           
         
       
     
     Data Acquisition and Cytometry Analysis 
     Data was acquired using FACS DIVA software on both LSR II and CANTO II Flow Cytometers (BD). For all analyses, dead cells and debris were excluded by forward scatter (FSC), side scatter (SSC), and Amine Aqua Viability Dye measurement. Leukemic cells were identified as cells that lacked the characteristics of mature lymphocytes (CD45++, CD33) and that fit the CD45 and CD33 versus right-angle light-scatter characteristics consistent with myeloid leukemia cells. 
     Statistical Analysis and Stratifying Node Selection 
     a) Metrics 
     The median fluorescence intensity (MFI) was computed for each node from the fluorescence intensity levels for the cells in the myeloid population. The MFI values were then used to compute a variety of metrics by comparing them to baseline or background values, including the unmodulated condition, cellular autofluorescence and antibody isotype controls. The following metrics were computed:
         1. Basal MFI (“Basal”)=log 2 (MFI Unmodulated Stained )−log 2 (MFI Gated Unstained (Autofluoresence) ), designed to measure the basal levels of a certain protein under unmodulated conditions.   2. Fold Change MFI (“Fold”)=log 2 (MFI Modulated Stained )−log 2 (MFI Unmodulated Stained ), a measure of the change in the activation state of a protein under modulated conditions.   3. Total Phospho MFI (“TotalPhospho”)=log 2 (MFI Modulated Stained )−log 2 (MFI Gated Unstained (Autofluorescence) ), a measure of the total levels of a protein under modulated conditions.   4. Relative Protein Expression (“Rel. Expression”)=log 2 (MFI Stain )−log 2 (MFI Control ), a measure of the levels of surface marker staining relative to control antibody staining.   5. Percent Cell Positivity (“PercentPos”)=a measure of the frequency of cells that have surface markers staining at an intensity level greater than the 95 th  percentile for isotype control antibody staining.   6. An additional metric was designed to measure the levels of cellular apoptosis in response to cytotoxic drugs: Quadrant (“Quad”)=a measure of the percentage of cells in a flow cytometry quadrant region defined by p-Chk2 and c-PARP i.e. the % of cells that are both p-Chk2− and c-PARP+.       

     b) Reproducibility Analysis 
     In the first study, two cryopreserved vials for all evaluable patient samples (n=34) were processed separately to assess overall assay reproducibility. Pearson and Spearman rank correlations were computed for each node/metric combination between the two data sets. 
     c) Univariate Analysis 
     All node/metric combinations were analyzed and compared across samples for their ability to distinguish between the CR and NR sample groups. Student t-test and Wilcoxon p values were computed for each node/metric combination. In addition, the area under the receiver operator characteristic (ROC) curve was computed to assess the diagnostic accuracy of each node/metric combination ( FIG. 8 ). 
     In the first study a total of 304 node/metric combinations were independently tested for differences between patient samples whose response to standard induction therapy was CR vs. NR. No corrections for multiple testing were applied to the p-values. Instead, simulations were performed by randomly permuting the clinical variable to estimate the number of node/metric combinations that might appear to be significant by chance. For each node/metric combination N cr  donors were randomly chosen (without replacement) and assigned to the CR category (where N cr  is the number of actual CRs in the original data set for that node/metric) and the remaining donors were assigned to the NR category. By comparing each node/metric to the permuted clinical variable, the student t-test p-values were computed. This process was repeated 10,000 times. The results were used to estimate the number of node/metrics expected to be significant by chance at the various p-values and compared with the empirical p-values for the number of node/metric combination found to be significant from the original data. 
     The statistical software package R, version 2.7.0 was used. 
     d) Correlations Between Node/Metric Combinations: 
     Correlations between all pairs of node/metric combination were assessed by computing Pearson and Spearman rank correlations. 
     e) Combinations of Node/Metrics 
     Nodes that can potentially complement each other to improve the accuracy of prediction of response to therapy were also explored. Given the small size of the data set, a straightforward “corner classifier” approach for picking combinations was adopted. Combinations that had an AUC greater than any included individual node/metric were tested for their robustness via a bootstrapping approach. 
     The corners classifier is a rule-based algorithm for dividing subjects into two classes (in this case the dichotomized response to induction therapy) using one or more numeric variables (defined in our study as a node/metric combination). This method works by setting a threshold on each variable, then combining the resulting intervals with “and” operator (e.g. X&lt;10, and Y&gt;50). This creates a rectangular region expected to hold most members of the class previously identified as the target (in this study clinical CR or NR sample groups). Threshold values can be chosen by minimizing an error criterion, however here in order to capture all CRs these values were set to either the maximum or the minimum value for each node/metric for all CRs. The accuracy of the corner classifier was measured by ranking the donors by their distance to the boundary. Donors that were inside the boundary were assigned a negative distance. This ranked list was used to compute an AUC under the ROC for the classifier. This AUC will be referred to as the ‘minimum distance AUC’. 
     A “bagging”, aka “bootstrapped aggregation”, was used to internally cross-validate the results of the above statistical model. Bootstrap resamples were drawn 1,000 times. For each resample a new corner classifier was computed, which was used to predict the class membership of those patients excluded from the resample. After repeating the resampling operation, each patient acquires a list of predicted class memberships based on classifiers computed using other patients. These predicted values were used to create an ROC curve and to calculate its AUC, which will be referred to as the ‘Bootstrap AUC’. The minimum distance AUC and bootstrap AUC together provide an estimate of the accuracy as well as the robustness of a combination of node/metrics. 
     Results 
     First Study: 
     a) Patient and Sample Characteristics. 
     Thirty-four evaluable AML PBMC samples were tested in the first study (Table 16 and 19). The sample set in this study was biased toward younger (&lt;60 years), female patients whose leukemia did not respond to induction chemotherapy. Compared to the typical distribution of AML patients, Asian ethnicity (29%) and intermediate-risk cytogenetic (76%) samples were overrepresented, though ethnicity was in alignment with the Toronto population. Furthermore, 10 of 18 (56%) cytogenetically normal (CN) samples tested expressed the FLT3 ITD phenotype, overall indicating a poor prognostic group of patients 17-19 . 
                     TABLE 19                  Demographic and Baseline Characteristics for All Patients (Intend To Diagnose) in Both Studies                                                 Characteristic   CR 1   NR 1   All Pts 1   P 1   CR 2   NR 2   All Pts 2   P 2                                                                 N   10   25   35       88   46   134           Age (yr)   Median   59.9   47.4   49.8   0.050   51.8   61.7   55.5   &lt;.001           Range   38.2-74.8   20.7-70.2   20.7-74.8       27.0-79.0   25.0-85.2   25.0-85.2           Age Group     &lt;60 yr   5 (50%)   20 (80%)    25 (71%)    0.107   71 (81%)   22 (48%)    93 (69%)   &lt;.001           &gt;=60 yr   5 (50%)   5 (20%)   10 (29%)        17 (19%)   24 (52%)    41 (31%)           Sex   F   7 (70%)   14 (56%)    21 (60%)    0.704   46 (52%)   24 (52%)    70 (52%)   1.000           M   3 (30%)   11 (44%)    14 (40%)        42 (48%)   22 (48%)    64 (48%)           Cytogentic   Favorable   0 (0%)    1 (4%)    1 (3%)    0.588   10 (11%)   0 (0%)   10 (7%)   &lt;.001       Group   Intermediate   9 (90%)   18 (72%)    27 (77%)        48 (55%)   12 (26%)    60 (45%)               Unfavorable   0 (0%)    3 (12%)   3 (9%)        30 (34%)   34 (74%)    64 (48%)               Not Done   1 (10%)   3 (12%)   4 (11%)        0 (0%)    0 (0%)    0 (0%)           FAB   M0   0 (0%)    2 (8%)    2 (6%)    0.316    2 (2%)    1 (2%)    3 (2%)   0.697           M1   2 (20%)   2 (8%)    4 (11%)       13 (15%)   3 (7%)    16 (12%)               M2   1 (10%)   5 (20%)   6 (17%)       31 (35%)   22 (48%)    53 (40%)               M4   1 (10%)   7 (28%)   8 (23%)       21 (24%)   11 (24%)    32 (24%)               M5   4 (40%)   2 (8%)    6 (17%)       15 (17%)    5 (11%)    20 (15%)               M6   0 (0%)    0 (0%)    0 (0%)         3 (3%)    2 (4%)    5 (4%)               Other &amp; Unk.   2 (20%)   7 (28%)   9 (26%)        3 (3%)    2 (4%)    5 (4%)           Race   White   4 (40%)   17 (68%)    21 (60%)    0.306   30 (34%)   20 (43%)    50 (37%)   0.473           Other &amp; Unk.*   6 (60%)   8 (32%)   14 (40%)        58 (66%)   26 (57%)    84 (63%)           FLT3-ITD   Negative   4 (40%)   14 (56%)    18 (51%)    0.615   67 (76%)   35 (76%)   102 (76%)   0.867           Positive   5 (50%)   10 (40%)    15 (43%)        17 (19%)    8 (17%)    25 (19%)               Unknown   1 (10%)   1 (4%)    2 (6%)         4 (5%)    3 (7%)    7 (5%)           Secondary    No   9 (90%)   25 (100%)   34 (97%)    0.286   73 (83%)   20 (43)       93 (69%)   &lt;.001       AML   Yes   1 (10%)   0 (0%)    1 (3%)        15 (17%)   26 (57%)    41 (31%)           Poor    No   2 (20%)   11 (44%)    13 (37%)    0.184   28 (32%)   3 (7%)    31 (23%)   &lt;.001       Prognosist †    Yes   8 (80%)   14 (56%)    22 (63%)        60 (68%)   43 (93%)   103 (77%)           Induction    7 + 3 Ara-C/   10 (100%)   25 (100%)   35 (100%)   n/a    0 (0%)    0 (0%)    0 (0%)   0.075       Therapy   Dauno                                           Fludarabine +   0 (0%)    0 (0%)    0 (0%)        18 (20%)   2 (4%)    20 (15%)               HDAC                                           IA + Zarnestra   0 (0%)    0 (0%)    0 (0%)        20 (23%)   11 (24%)    31 (23%)               IDA + HDAC   0 (0%)    0 (0%)    0 (0%)        24 (27%)   15 (33%)    39 (29%)               Other   0 (0%)    0 (0%)    0 (0%)        26 (30%)   18 (39%)    44 (33%)               *The “Other” values for race are based on Black, Asian, and Hispanic sub groups       † Poor prognosis is defined as having one ore more of the following high risk features: age &gt;60 years, unfavorable cytogenetics, FLT3 ITD positive or secondary AML            
There were 38 primary refractory patients and 8 failed patients in Study No 2. The two sample t-test was used to compare mean ages of CR and NR patients. Fishers Exact test was used to compare CR and NR patient samples with respect to categorical variables with two levels. The standard Chi-Square test was used to compare CR and NR patients with respect to categorical variables with three or more levels.
 
     b) Assay Reproducibility. 
     Good correlation (Pearson coefficient ≧0.8) was found between the data from the repeated assays (covering the thawing, stimulating, staining, gating and data analysis steps of the assays) performed using duplicate vials. As expected, assay reproducibility was better for nodes with a large range of signaling (not shown) as measured by standard deviation (SD), e.g. read outs for: SCF/p-Akt, FLT3L/p-Akt and G-CSF/p-Stat5. Node/metric combinations with less reproducible results included those with a very low range of signaling and SD, including G-CSF/p-Stat1, II27/p-CREB, SDF1-α/p-Erk (Table 20). 
     
       
         
           
               
             
               
                 TABLE 20 
               
             
            
               
                   
               
               
                 Reproducibility: Study No. 1 
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                 Node:  
                   
                 Biological  
                 Num. 
                 Pearson 
                 Spearman 
                   
                 SD 
               
               
                 Modulator/Read-Out 
                 Metric 
                 Category 
                 Pts 
                 Coefficient 
                 Coefficient 
                 R2 
                 Value 
               
               
                   
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                 FLT3L/p-Akt 
                 Fold 
                 CCG 
                 34 
                 0.92 
                 0.82 
                 0.84 
                 0.59 
               
               
                 FLT3L/p-Akt 
                 TotalPhospho 
                 CCG 
                 34 
                 0.92 
                 0.94 
                 0.85 
                 0.95 
               
               
                 FLT3L/p-Erk 
                 Fold 
                 CCG 
                 34 
                 0.69 
                 0.56 
                 0.48 
                 0.23 
               
               
                 FLT3L/p-Erk 
                 TotalPhospho 
                 CCG 
                 34 
                 0.63 
                 0.61 
                 0.39 
                 0.58 
               
               
                 FLT3L/p-S6 
                 Fold 
                 CCG 
                 34 
                 0.92 
                 0.72 
                 0.84 
                 0.70 
               
               
                 FLT3L/p-S6 
                 TotalPhospho 
                 CCG 
                 34 
                 0.84 
                 0.82 
                 0.70 
                 0.86 
               
               
                 G-CSF/p-Stat1 
                 Fold 
                 CCG 
                 33 
                 0.14 
                 0.19 
                 0.02 
                 0.18 
               
               
                 G-CSF/p-Stat1 
                 TotalPhospho 
                 CCG 
                 33 
                 0.30 
                 0.47 
                 0.09 
                 0.26 
               
               
                 G-CSF/p-Stat3 
                 Fold 
                 CCG 
                 33 
                 0.85 
                 0.83 
                 0.73 
                 1.01 
               
               
                 G-CSF/p-Stat3 
                 TotalPhospho 
                 CCG 
                 33 
                 0.80 
                 0.76 
                 0.64 
                 1.14 
               
               
                 G-CSF/p-Stat5 
                 Fold 
                 CCG 
                 33 
                 0.86 
                 0.76 
                 0.74 
                 0.97 
               
               
                 G-CSF/p-Stat5 
                 TotalPhospho 
                 CCG 
                 33 
                 0.87 
                 0.85 
                 0.76 
                 1.25 
               
               
                 IFNα/p-Stat1 
                 Fold 
                 CCG 
                 34 
                 0.59 
                 0.55 
                 0.34 
                 0.47 
               
               
                 IFNα/p-Stat1 
                 TotalPhospho 
                 CCG 
                 34 
                 0.73 
                 0.72 
                 0.54 
                 0.52 
               
               
                 IFNα/p-Stat3 
                 Fold 
                 CCG 
                 34 
                 0.77 
                 0.79 
                 0.59 
                 0.56 
               
               
                 IFNα/p-Stat3 
                 TotalPhospho 
                 CCG 
                 34 
                 0.73 
                 0.71 
                 0.53 
                 0.74 
               
               
                 IFNα/p-Stat5 
                 Fold 
                 CCG 
                 34 
                 0.75 
                 0.78 
                 0.57 
                 0.85 
               
               
                 IFNα/p-Stat5 
                 TotalPhospho 
                 CCG 
                 34 
                 0.92 
                 0.92 
                 0.85 
                 1.30 
               
               
                 IFNγ/p-Stat1 
                 Fold 
                 CCG 
                 34 
                 0.52 
                 0.49 
                 0.27 
                 0.67 
               
               
                 IFNγ/p-Stat1 
                 TotalPhospho 
                 CCG 
                 34 
                 0.69 
                 0.66 
                 0.47 
                 0.71 
               
               
                 IFNγ/p-Stat3 
                 Fold 
                 CCG 
                 34 
                 0.52 
                 0.39 
                 0.27 
                 0.28 
               
               
                 IFNγ/p-Stat3 
                 TotalPhospho 
                 CCG 
                 34 
                 0.56 
                 0.62 
                 0.32 
                 0.42 
               
               
                 IFNγ/p-Stat5 
                 Fold 
                 CCG 
                 34 
                 0.46 
                 0.52 
                 0.21 
                 0.52 
               
               
                 IFNγ/p-Stat5 
                 TotalPhospho 
                 CCG 
                 34 
                 0.82 
                 0.82 
                 0.68 
                 0.83 
               
               
                 IL-27/p-CREB 
                 Fold 
                 CCG 
                 34 
                 0.34 
                 0.37 
                 0.11 
                 0.21 
               
               
                 IL-27/p-CREB 
                 TotalPhospho 
                 CCG 
                 34 
                 0.78 
                 0.78 
                 0.61 
                 0.74 
               
               
                 IL-27/p-Erk 
                 Fold 
                 CCG 
                 34 
                 0.01 
                 −0.05 
                 0.00 
                 0.18 
               
               
                 IL-27/p-Erk 
                 TotalPhospho 
                 CCG 
                 34 
                 0.78 
                 0.66 
                 0.61 
                 0.72 
               
               
                 IL-27/p-S6 
                 Fold 
                 CCG 
                 34 
                 0.21 
                 0.10 
                 0.04 
                 0.06 
               
               
                 IL-27/p-S6 
                 TotalPhospho 
                 CCG 
                 34 
                 0.70 
                 0.82 
                 0.48 
                 0.40 
               
               
                 none/p-Akt 
                 Basal 
                 CCG 
                 34 
                 0.94 
                 0.96 
                 0.89 
                 0.57 
               
               
                 none/p-CREB 
                 Basal 
                 CCG 
                 34 
                 0.81 
                 0.73 
                 0.66 
                 0.72 
               
               
                 none/p-Erk (AF647) 
                 Basal 
                 CCG 
                 34 
                 0.93 
                 0.90 
                 0.86 
                 0.67 
               
               
                 none/p-Erk (PE) 
                 Basal 
                 CCG 
                 34 
                 0.72 
                 0.69 
                 0.52 
                 0.52 
               
               
                 none/p-S6 
                 Basal 
                 CCG 
                 34 
                 0.83 
                 0.79 
                 0.68 
                 0.36 
               
               
                 none/p-Stat1 
                 Basal 
                 CCG 
                 34 
                 0.42 
                 0.53 
                 0.17 
                 0.21 
               
               
                 none/p-Stat3 
                 Basal 
                 CCG 
                 34 
                 0.49 
                 0.53 
                 0.24 
                 0.37 
               
               
                 none/p-Stat5 
                 Basal 
                 CCG 
                 34 
                 0.88 
                 0.88 
                 0.77 
                 0.82 
               
               
                 PMA/p-CREB 
                 Fold 
                 CCG 
                 34 
                 0.85 
                 0.85 
                 0.73 
                 0.92 
               
               
                 PMA/p-CREB 
                 TotalPhospho 
                 CCG 
                 34 
                 0.86 
                 0.90 
                 0.75 
                 1.23 
               
               
                 PMA/p-Erk 
                 Fold 
                 CCG 
                 34 
                 0.74 
                 0.75 
                 0.55 
                 0.85 
               
               
                 PMA/p-Erk 
                 TotalPhospho 
                 CCG 
                 34 
                 0.83 
                 0.81 
                 0.70 
                 1.21 
               
               
                 PMA/p-S6 
                 Fold 
                 CCG 
                 34 
                 0.95 
                 0.95 
                 0.90 
                 0.86 
               
               
                 PMA/p-S6 
                 TotalPhospho 
                 CCG 
                 34 
                 0.92 
                 0.94 
                 0.85 
                 0.82 
               
               
                 SCF/p-Akt 
                 Fold 
                 CCG 
                 34 
                 0.86 
                 0.83 
                 0.74 
                 0.53 
               
               
                 SCF/p-Akt 
                 TotalPhospho 
                 CCG 
                 34 
                 0.93 
                 0.91 
                 0.87 
                 0.71 
               
               
                 SCF/p-Erk 
                 Fold 
                 CCG 
                 34 
                 0.39 
                 0.39 
                 0.15 
                 0.18 
               
               
                 SCF/p-Erk 
                 TotalPhospho 
                 CCG 
                 34 
                 0.68 
                 0.61 
                 0.46 
                 0.50 
               
               
                 SCF/p-S6 
                 Fold 
                 CCG 
                 34 
                 0.91 
                 0.91 
                 0.83 
                 0.56 
               
               
                 SCF/p-S6 
                 TotalPhospho 
                 CCG 
                 34 
                 0.86 
                 0.84 
                 0.75 
                 0.62 
               
               
                 SDF-1α/p-Akt 
                 Fold 
                 CCG 
                 34 
                 0.87 
                 0.85 
                 0.76 
                 0.42 
               
               
                 SDF-1α/p-Akt 
                 TotalPhospho 
                 CCG 
                 34 
                 0.91 
                 0.90 
                 0.83 
                 0.70 
               
               
                 SDF-1α/p-Erk 
                 Fold 
                 CCG 
                 34 
                 0.38 
                 0.49 
                 0.15 
                 0.22 
               
               
                 SDF-1α/P-Erk 
                 TotalPhosPho 
                 CCG 
                 34 
                 0.58 
                 0.53 
                 0.34 
                 0.64 
               
               
                 SDF-1α/p-S6 
                 Fold 
                 CCG 
                 34 
                 0.12 
                 0.17 
                 0.01 
                 0.09 
               
               
                 SDF-1α/P-S6 
                 TotalPhosPho 
                 CCG 
                 34 
                 0.66 
                 0.59 
                 0.44 
                 0.35 
               
               
                 Thapsigargin/p-CREB 
                 Fold 
                 CCG 
                 34 
                 0.89 
                 0.91 
                 0.80 
                 0.70 
               
               
                 Thapsigargin/p-CREB 
                 TotalPhosPho 
                 CCG 
                 34 
                 0.90 
                 0.89 
                 0.81 
                 0.95 
               
               
                 Thapsigargin/p-Erk 
                 Fold 
                 CCG 
                 34 
                 0.94 
                 0.56 
                 0.88 
                 0.43 
               
               
                 Thapsigargin/p-Erk 
                 TotalPhosPho 
                 CCG 
                 34 
                 0.94 
                 0.89 
                 0.87 
                 0.89 
               
               
                 Thapsigargin/p-S6 
                 Fold 
                 CCG 
                 34 
                 0.91 
                 0.79 
                 0.82 
                 0.40 
               
               
                 Thapsigargin/p-S6 
                 TotalPhospho 
                 CCG 
                 34 
                 0.86 
                 0.81 
                 0.74 
                 0.50 
               
               
                   
               
               
                 Table is sorted alphabetically by node 
               
               
                 Node/metrics with a t-test p value or Wilcoxon p value of ≦0.5 and an AUC of ≧.66 are shown 
               
               
                 Metris are defined in Materials and Methods 
               
               
                 Abbreviations are defined in Table 17 
               
            
           
         
       
     
     c) Univariate Analysis. 
     In the first study, 147 nodes were assessed for their association with clinical response to standard AML induction therapy. The chosen nodes represented four biologic categories thought to be relevant to AML disease pathophysiology ( FIG. 1 ): a) nodes modulated by myeloid cytokines, chemokines and growth factors; b) nodes modulated by intracellular phosphatases; c) protein expression levels of drug transporters and surface myeloid growth factor receptors; and d) nodes related to apoptosis. Each node was assessed using 2-3 metrics, creating 304 node/metrics. Univariate analysis, unadjusted for multiple testing, was performed on all node/metrics, which were then ranked by AUC of the ROC plots. Fifty-eight node/metrics (Table 21) from all four biological categories had an AUC above 0.66 and a p value ≦0.05 (Student t-test or Wilcoxon), a cut off chosen to be higher than the AUC of the ROC plot for age (an accepted prognostic factor for this disease). Sixty-six nodes were not considered candidates for future development and remove prior to the second cohort due to low induced signaling or high correlation with other nodes. As expected, significant heterogeneity was found across most of the nodes measured, highlighting both the diverse biology underlying the disease and the ability of modulated SCNP to quantitatively resolve this heterogeneity at the single cell level. Furthermore, different populations of cells with differing degrees of responsiveness were observed within a patient for a given node/metric combination. 
     
       
         
           
               
             
               
                 TABLE 21 
               
             
            
               
                   
               
               
                 Univariate Analysis of Node/Metrics for Study No. 1 
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                 Node:  
                   
                 Biologic  
                 Num. 
                   
                 Wilcoxon 
                 AUC of 
                 Mean Value  
               
               
                 Modulator/Read-Out 
                 Metric 
                 Category 
                 CRs/NRs 
                 t-test P 
                 P 
                 ROC 
                 of CRs/NRs 
               
               
                   
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                 ABCG2 
                 PercentPos 
                 Surface  
                 8/23 
                 0.009 
                 0.034 
                 0.76 
                 6.51/8.14 
               
               
                   
                   
                 Markers 
                   
                   
                   
                   
                   
               
               
                 CD40L/p-CREB 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.004 
                 0.003 
                 0.83 
                 1.55/2.66 
               
               
                 CD40L/p-Erk 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.013 
                 0.015 
                 0.77 
                 1.18/1.64 
               
               
                 cKit 
                 Rel.  
                 Surface  
                 8/23 
                 0.012 
                 0.018 
                 0.78 
                 1.63/2.41 
               
               
                   
                 Expression 
                 Markers 
                   
                   
                   
                   
                   
               
               
                 cKit 
                 PercentPos 
                 Surface  
                 8/23 
                 0.047 
                 0.082 
                 0.71 
                 41.6/59.6 
               
               
                   
                   
                 Markers 
                   
                   
                   
                   
                   
               
               
                 EPO/p-Stat1 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.053 
                 0.037 
                 0.74 
                 0.20/0.42 
               
               
                 EPO/p-Stat3 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.003 
                 0.002 
                 0.84 
                 0.72/1.23 
               
               
                 Etoposide &amp; ZVAD/ 
                 TotalPhospho 
                 Apoptosis 
                 7/20 
                 0.084 
                 0.048 
                 0.76 
                 1.48/0.67 
               
               
                 c-Caspase 3 
                   
                   
                   
                   
                   
                   
                   
               
               
                 Etoposide &amp; ZVAD/ 
                 Quad 
                 Apoptosis 
                 7/22 
                 0.019 
                 0.010 
                 0.83 
                 0.22/0.10 
               
               
                 p-Chk2−, c-PARP+ 
                   
                   
                   
                   
                   
                   
                   
               
               
                 Etoposide/p-Chk2−,  
                 Quad 
                 Apoptosis 
                 7/22 
                 0.010 
                 0.015 
                 0.81 
                 0.49/0.27 
               
               
                 c-PARP+ 
                   
                   
                   
                   
                   
                   
                   
               
               
                 FLT3R 
                 TotalPhospho 
                 Surface  
                 8/23 
                 0.014 
                 0.026 
                 0.77 
                 1.81/2.58 
               
               
                   
                   
                 Markers 
                   
                   
                   
                   
                   
               
               
                 FLT3R 
                 Rel.  
                 Surface  
                 8/23 
                 0.004 
                 0.006 
                 0.82 
                 1.32/2.23 
               
               
                   
                 Expression 
                 Markers 
                   
                   
                   
                   
                   
               
               
                 FLT3L/p-Akt 
                 Fold 
                 CCG 
                 9/25 
                 0.003 
                 0.004 
                 0.82 
                 0.18/0.64 
               
               
                 FLT3L/p-CREB 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.014 
                 0.012 
                 0.78 
                 1.50/2.12 
               
               
                 FLT3L/p-plcγ2 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.007 
                 0.006 
                 0.80 
                 1.88/2.80 
               
               
                 FLT3L/p-S6 
                 Fold 
                 CCG 
                 9/25 
                 0.026 
                 0.154 
                 0.66 
                 0.28/0.81 
               
               
                 G-CSF/p-Stat3 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.056 
                 0.050 
                 0.72 
                 1.66/2.70 
               
               
                 G-CSF/p-Stat5 
                 Fold 
                 CCG 
                 9/25 
                 0.038 
                 0.072 
                 0.71 
                 0.47/1.13 
               
               
                 GM-CSF/p-Stat3 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.002 
                 0.005 
                 0.81 
                 0.84/1.24 
               
               
                 H 2 O 2  &amp; SCF/p-Erk 
                 TotalPhospho 
                 Phosphatase 
                 7/22 
                 0.047 
                 0.122 
                 0.70 
                 2.16/2.57 
               
               
                 H 2 O 2  &amp; SCF/p-plcγ2 
                 Fold 
                 Phosphatase 
                 7/22 
                 0.102 
                 0.032 
                 0.77 
                   0.47/−0.14 
               
               
                 H 2 O 2  &amp; SCF/p-SLP 76 
                 Fold 
                 Phosphatase 
                 7/22 
                 0.026 
                 0.042 
                 0.76 
                 1.37/0.06 
               
               
                 H 2 O 2 /p-Lck 
                 Fold 
                 Phosphatase 
                 7/22 
                 0.163 
                 0.050 
                 0.75 
                 0.42/0.12 
               
               
                 H 2 O 2 /p-SLP 76 
                 Fold 
                 Phosphatase 
                 7/22 
                 0.024 
                 0.028 
                 0.78 
                 1.35/0.08 
               
               
                 IFNα/p-Stat1 
                 Fold 
                 CCG 
                 9/25 
                 0.017 
                 0.030 
                 0.75 
                 0.55/0.78 
               
               
                 IFNγ/p-Stat1 
                 Fold 
                 CCG 
                 9/25 
                 0.039 
                 0.072 
                 0.71 
                 0.53/0.90 
               
               
                 IFNγ/p-Stat3 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.002 
                 0.003 
                 0.83 
                 0.74/1.30 
               
               
                 IGF-1/p-CREB 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.006 
                 0.004 
                 0.82 
                 1.52/2.29 
               
               
                 IGF-1/p-Plcγ2 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.006 
                 0.005 
                 0.81 
                 1.91/2.76 
               
               
                 IL-10/p-Stat1 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.035 
                 0.037 
                 0.74 
                 0.20/0.47 
               
               
                 IL-10/p-Stat3 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.001 
                 0.002 
                 0.84 
                 0.82/1.69 
               
               
                 IL-27/p-CREB 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.003 
                 0.002 
                 0.84 
                 1.40/2.35 
               
               
                 IL-27/p-Stat1 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.001 
                 0.003 
                 0.83 
                 0.41/0.82 
               
               
                 IL-27/p-Stat3 
                 TotalPhospho 
                 CCG 
                 9/25 
                 &lt;0.001 
                 &lt;0.001 
                 0.90 
                 1.07/1.86 
               
               
                 IL-3/p-CREB 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.004 
                 0.002 
                 0.84 
                 1.64/2.57 
               
               
                 IL-3/p-Stat1 
                 Fold 
                 CCG 
                 9/25 
                 0.018 
                 0.024 
                 0.76 
                   0.05/−0.01 
               
               
                 IL-3/p-Stat3 
                 Fold 
                 CCG 
                 9/25 
                 0.052 
                 0.026 
                 0.76 
                   0.13/−0.05 
               
               
                 IL-3/p-Stat3 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.039 
                 0.102 
                 0.69 
                 1.05/1.29 
               
               
                 IL-6/p-CREB 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.020 
                 0.019 
                 0.76 
                 1.70/2.43 
               
               
                 IL-6/p-Stat3 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.001 
                 0.015 
                 0.77 
                 1.08/1.84 
               
               
                 M-CSF/p-Plcγ2 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.006 
                 0.005 
                 0.81 
                 1.86/2.81 
               
               
                 none/p-CREB 
                 Basal 
                 CCG 
                 9/25 
                 0.001 
                 0.001 
                 0.87 
                 1.58/2.53 
               
               
                 none/p-Erk 
                 Basal 
                 CCG 
                 9/25 
                 0.028 
                 0.015 
                 0.77 
                 1.69/2.09 
               
               
                 none/p-Plcγ2 
                 Basal 
                 CCG 
                 9/25 
                 0.008 
                 0.009 
                 0.79 
                 1.73/2.48 
               
               
                 none/p-Stat3 
                 Basal 
                 CCG 
                 9/25 
                 0.005 
                 0.005 
                 0.81 
                 0.89/1.33 
               
               
                 none/p-Stat6 
                 Basal 
                 CCG 
                 9/25 
                 0.008 
                 0.019 
                 0.76 
                 0.62/0.96 
               
               
                 SCF/p-Akt 
                 Fold 
                 CCG 
                 9/25 
                 0.018 
                 0.007 
                 0.81 
                 0.12/0.57 
               
               
                 SCF/p-CREB 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.016 
                 0.030 
                 0.75 
                 1.38/1.92 
               
               
                 SCF/p-Erk 
                 Fold 
                 CCG 
                 9/25 
                 0.043 
                 0.041 
                 0.73 
                 −0.05/0.11   
               
               
                 SCF/p-Erk 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.049 
                 0.030 
                 0.75 
                 1.87/2.28 
               
               
                 SCF/p-Plcγ2 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.006 
                 0.006 
                 0.80 
                 1.87/2.81 
               
               
                 SDF-1α/p-Akt 
                 Fold 
                 CCG 
                 9/25 
                 0.025 
                 0.067 
                 0.71 
                 0.20/0.53 
               
               
                 SDF-1α/p-Akt 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.045 
                 0.120 
                 0.68 
                 0.57/1.04 
               
               
                 SDF-1α/p-Erk 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.056 
                 0.041 
                 0.73 
                 1.80/2.28 
               
               
                 Thapsigargin/p-CREB 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.034 
                 0.027 
                 0.75 
                 1.90/2.76 
               
               
                 Thapsigargin/p-S6 
                 Fold 
                 CCG 
                 9/25 
                 0.021 
                 0.076 
                 0.70 
                 0.04/0.32 
               
               
                 Thapsigargin/p-S6 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.018 
                 0.045 
                 0.73 
                 0.31/0.68 
               
               
                 TNFα/p-Erk 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.033 
                 0.050 
                 0.72 
                 1.25/1.65 
               
               
                   
               
               
                 Node/metrics with a t-test p value or Wilcoxon p value of ≦0.5 and an AUC of ≧.66 are shown 
               
               
                 Negative mean CR/NR values represent down regulation as compared to reference/control/normalization 
               
               
                 Table is sorted alphabetically by node 
               
               
                 Metrics are defined in Materials and Methods 
               
               
                 Abbreviations are defined in Supplemental Table 1 
               
            
           
         
       
     
     Importantly, measurements of basal levels of phosphorylated signaling proteins, such as p-Stat5, p-Akt and p-S6, were not informative in classifying patient samples by clinical response (with AUC of the ROCs values of 0.62, 0.52, and 0.51, respectively (Table 22). However, G-CSF, SCF or Flt3L mediated phosphorylation resulted in significant increases in the Fold metric between patient samples categorized by response and AUC of the ROC values, which increased to 0.71, 0.82, and 0.66 respectively (Table 22), allowing patient stratification into CR or NR categories. The SCF/p-Akt read out is an example shown in  FIG. 8A . These data suggest that increased growth factor-mediated signaling occurred in samples derived from NR patients, consistent with the previous findings of Irish et al. 4  Interestingly, the basal expression of cell surface receptors Flt3R and c-Kit also stratified patient samples as CR versus NR with AUC of the ROC plots of 0.82 and 0.78 respectively, confirming a role for these receptors in treatment prediction (Table 21). 

 
     Responses to DNA damage and apoptosis were determined by measuring levels of p-Chk2 and cleaved c-PARP respectively, after exposure of samples to etoposide, a topoisomerase II inhibitor. Notably, decreased levels of p-Chk2 and increased levels of c-PARP were seen in CR samples, indicating that the DNA damage response pathway was able to activate apoptosis in these patient samples. In contrast, most NR samples showed accumulated levels of p-Chk2 and low levels of c-PARP suggesting a block in the signals that relay DNA damage to the apoptotic machinery. These data suggest that an efficient relay of signals from the DNA damage response pathway to the apoptotic machinery may be necessary for response to induction therapy. 
     Because of the high number of variables tested on a relatively small sample set, an assessment of false discovery rate was performed (see Material and Methods). The number of observed node/metrics with a Student t-test p≦0.05 in our data set was 56, which is higher than expected after random assignment (not shown). Therefore, the estimated probability that the number of nodes found to be significant from the experimental data occurred by chance is less than 0.02. 
     Sensitivity univariate analysis was performed to test the effect of inclusion of the CRp sample within the NR sample cohort. These analyses resulted in an increase in AUC of the ROC plots for the majority of nodes examined, suggesting that the biology of the blasts contained within the CRp sample was more similar to NR than CR samples (Table 23). 
     
       
         
           
               
             
               
                 TABLE 23 
               
             
            
               
                   
               
               
                 Sensitivity Analysis for Study No. 1: Univariate Analysis of Node/Metrics with CRp Patient Included  
               
               
                 in NR Group 
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                   
                   
                 Biologic  
                   
                 Wilcoxon 
                 AUC of 
                 Mean Value  
                 Num. 
               
               
                 Node 
                 Metric 
                 Category 
                 t-test P 
                 P 
                 ROC 
                 of CRs/NRs 
                 CRs/NRs 
               
               
                   
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                 ABCG2 
                 Rel.  
                 Surface  
                 0.002 
                 0.022 
                 0.79 
                 0.14/0.33 
                 7/24 
               
               
                   
                 Expression 
                 Markers 
                   
                   
                   
                   
                   
               
               
                 ABCG2 
                 PercentPos 
                 Surface  
                 0.003 
                 0.017 
                 0.80 
                 6.32/8.13 
                 7/24 
               
               
                   
                   
                 Markers 
                   
                   
                   
                   
                   
               
               
                 CD40L/p-CREB 
                 Total Phospho 
                 CCG 
                 0.001 
                 &lt;.001 
                 0.89 
                 1.37/2.67 
                 8/26 
               
               
                 CD40L/p-Erk 
                 Total Phospho 
                 CCG 
                 0.027 
                 0.039 
                 0.75 
                 1.18/1.62 
                 8/26 
               
               
                 cKit 
                 Rel.  
                 Surface  
                 0.007 
                 0.012 
                 0.81 
                 1.53/2.41 
                 7/24 
               
               
                   
                 Expression 
                 Markers 
                   
                   
                   
                   
                   
               
               
                 cKit 
                 Ppos 
                 CCG 
                 0.024 
                 0.033 
                 0.77 
                 38.42/59.75 
                 7/24 
               
               
                 EPO/p-Stat1 
                 Total Phospho 
                 CCG 
                 0.050 
                 0.025 
                 0.76 
                 0.17/0.42 
                 8/26 
               
               
                 EPO/p-Stat3 
                 Total Phospho 
                 CCG 
                 &lt;.001 
                 &lt;.001 
                 0.90 
                 0.64/1.23 
                 8/26 
               
               
                 Etoposide + ZVAD/ 
                 Quad 
                 Apoptosis 
                 0.044 
                 0.025 
                 0.80 
                 0.23/0.11 
                 6/23 
               
               
                 Chk2-PARP+ 
                   
                   
                   
                   
                   
                   
                   
               
               
                 Etoposide 24 h/ 
                 Quad 
                 Apoptosis 
                 0.026 
                 0.025 
                 0.80 
                 0.49/0.28 
                 6/23 
               
               
                 Chk2-PARP+ 
                   
                   
                   
                   
                   
                   
                   
               
               
                 FLT3L/p-Ak1 
                 Fold 
                 CCG 
                 &lt;.001 
                 &lt;.001 
                 0.90 
                 0.10/0.65 
                 8/26 
               
               
                 FLT3L/p-CREB 
                 Fold 
                 CCG 
                 0.013 
                 0.096 
                 0.70 
                 0.07/0.36 
                 8/26 
               
               
                 FLT3L/p-CREB 
                 Total Phospho 
                 CCG 
                 0.004 
                 0.003 
                 0.84 
                 1.39/2.13 
                 8/26 
               
               
                 FLT3L/p-Erk 
                 Fold 
                 CCG 
                 0.013 
                 0.013 
                 0.79 
                 0.08/0.33 
                 8/26 
               
               
                 FLT3L/p-Plcγ2 
                 Total Phospho 
                 CCG 
                 0.008 
                 0.004 
                 0.83 
                 1.81/2.78 
                 8/26 
               
               
                 FLT3L/p-Plcγ2 
                 Fold 
                 CCG 
                 0.144 
                 0.049 
                 0.74 
                 −0.14/−0.08 
                 8/26 
               
               
                 FLT3L/p-S6 
                 Fold 
                 CCG 
                 &lt;.001 
                 0.056 
                 0.73 
                 0.14/0.83 
                 8/26 
               
               
                 FLT3R 
                 Rel.  
                 Surface  
                 &lt;.001 
                 0.001 
                 0.89 
                 1.16/2.24 
                 7/24 
               
               
                   
                 Expression 
                 Markers 
                   
                   
                   
                   
                   
               
               
                 FLT3R 
                 PercentPos 
                 Surface  
                 0.009 
                 0.008 
                 0.83 
                 49.72/76.39 
                 7/24 
               
               
                   
                   
                 Markers 
                   
                   
                   
                   
                   
               
               
                 FLT3R 
                 Total Phospho 
                 Surface  
                 0.037 
                 0.061 
                 0.74 
                 1.84/2.55 
                 7/24 
               
               
                   
                   
                 Markers 
                   
                   
                   
                   
                   
               
               
                 G-CSF/p-Stat3 
                 Fold 
                 CCG 
                 0.010 
                 0.031 
                 0.75 
                 0.60/1.52 
                 8/26 
               
               
                 G-CSF/p-Stat3 
                 Total Phospho 
                 CCG 
                 0.013 
                 0.009 
                 0.80 
                 1.40/2.74 
                 8/26 
               
               
                 G-CSF/p-Stat5 
                 Fold 
                 CCG 
                 0.006 
                 0.022 
                 0.77 
                 0.33/1.15 
                 8/26 
               
               
                 GM-CSF/p-Stat3 
                 Total Phospho 
                 CCG 
                 0.004 
                 0.007 
                 0.81 
                 0.83/1.23 
                 8/26 
               
               
                 IFNγ/p-Stat1 
                 Fold 
                 CCG 
                 0.006 
                 0.015 
                 0.78 
                 0.45/0.91 
                 8/26 
               
               
                 IFNα/p-Stat1 
                 Fold 
                 CCG 
                 0.004 
                 0.009 
                 0.80 
                 0.50/0.79 
                 8/26 
               
               
                 IFNγ/p-Stat1 
                 Total Phospho 
                 CCG 
                 0.027 
                 0.012 
                 0.79 
                 0.67/1.27 
                 8/26 
               
               
                 IFNγ/p-Stat3 
                 Total Phospho 
                 CCG 
                 0.001 
                 0.001 
                 0.88 
                 0.68/1.3  
                 8/26 
               
               
                 IFNγ/p-Stat5 
                 Total Phospho 
                 CCG 
                 0.058 
                 0.043 
                 0.74 
                 1.62/2.35 
                 8/26 
               
               
                 IGF-1/p-CREB PE 
                 Total Phospho 
                 CCG 
                 0.003 
                 0.001 
                 0.87 
                 1.42/2.29 
                 8/26 
               
               
                 IGF-1/p-CREB Alexa488 
                 Total Phospho 
                 CCG 
                 0.097 
                 0.053 
                 0.73 
                 1.11/1.62 
                 8/26 
               
               
                 IGF-1/p-Plcγ2 
                 Total Phospho 
                 CCG 
                 0.004 
                 0.003 
                 0.84 
                 1.82/2.76 
                 8/26 
               
               
                 IL-3/p-Stat1 
                 Fold 
                 CCG 
                 0.042 
                 0.062 
                 0.73 
                   0.05/−0.01 
                 8/26 
               
               
                 IL-10/p-Stat1 
                 Total Phospho 
                 CCG 
                 0.033 
                 0.025 
                 0.76 
                 0.17/0.47 
                 8/26 
               
               
                 IL-10/p-Stat3 
                 Total Phospho 
                 CCG 
                 &lt;.001 
                 &lt;.001 
                 0.89 
                 0.72/1.69 
                 8/26 
               
               
                 IL-27/p-CREB 
                 Total Phospho 
                 CCG 
                 &lt;.001 
                 &lt;.001 
                 0.90 
                 1.25/2.36 
                 8/26 
               
               
                 IL-27/p-Stat1 
                 Total Phospho 
                 CCG 
                 0.002 
                 0.003 
                 0.84 
                 0.39/0.81 
                 8/26 
               
               
                 IL-27p-Stat 
                 Total Phospho 
                 CCG 
                 &lt;.001 
                 &lt;.001 
                 0.93 
                 1.01/1.85 
                 8/26 
               
               
                 IL-3/p-CREB 
                 Total Phospho 
                 CCG 
                 0.001 
                 0.001 
                 0.88 
                 1.51/2.58 
                 8/26 
               
               
                 IL-3/p-Stat3 
                 Fold 
                 CCG 
                 0.062 
                 0.042 
                 0.75 
                   0.15/−0.04 
                 8/26 
               
               
                 IL-6/p-CREB 
                 Total Phospho 
                 CCG 
                 0.008 
                 0.006 
                 0.82 
                 1.58/2.44 
                 8/26 
               
               
                 IL-6/p-Stat3 
                 Total Phospho 
                 CCG 
                 0.002 
                 0.025 
                 0.76 
                 1.08/1.81 
                 8/26 
               
               
                 M-CSF/p-Akt 
                 Fold 
                 CCG 
                 0.035 
                 0.059 
                 0.73 
                 −0.16/0.05   
                 8/26 
               
               
                 M-CSF/p-CREB 
                 Total Phospho 
                 CCG 
                 0.067 
                 0.039 
                 0.75 
                 1.26/1.76 
                 8/26 
               
               
                 M-CSF/p-Plcγ2 
                 Total Phospho 
                 CCG 
                 0.007 
                 0.006 
                 0.82 
                 1.79/2.8  
                 8/26 
               
               
                 none/p-CREB 
                 Basal 
                 CCG 
                 &lt;.001 
                 &lt;.001 
                 0.92 
                 1.47/2.53 
                 8/26 
               
               
                 none/p-Erk 
                 Basal 
                 CCG 
                 0.051 
                 0.035 
                 0.75 
                 1.69/2.07 
                 8/26 
               
               
                 none/p-Plcγ2 
                 Basal 
                 CCG 
                 0.011 
                 0.017 
                 0.78 
                 1.70/2.46 
                 8/26 
               
               
                 none/p-Stat3 
                 Basal 
                 CCG 
                 0.004 
                 0.003 
                 0.84 
                 0.85/1.32 
                 8/26 
               
               
                 none/p-Stat6 
                 Basal 
                 CCG 
                 0.017 
                 0.031 
                 0.75 
                 0.61/0.95 
                 8/26 
               
               
                 PMA/p-Erk 
                 Fold 
                 CCG 
                 0.039 
                 0.035 
                 0.75 
                 1.46/2.03 
                 8/26 
               
               
                 SCF/p-Akt 
                 Fold 
                 CCG 
                 0.023 
                 0.005 
                 0.83 
                 0.09/0.56 
                 8/26 
               
               
                 SCF/p-CREB 
                 Total Phospho 
                 CCG 
                 0.013 
                 0.020 
                 0.77 
                 1.32/1.92 
                 8/26 
               
               
                 SCF/p-Erk 
                 Fold 
                 CCG 
                 0.040 
                 0.031 
                 0.75 
                 −0.06/0.11   
                 8/26 
               
               
                 SCF/p-Plcγ2 
                 Total Phospho 
                 CCG 
                 0.007 
                 0.006 
                 0.82 
                 1.80/2.79 
                 8/26 
               
               
                 SDF-1α/p-Akt 
                 Fold 
                 CCG 
                 0.008 
                 0.024 
                 0.77 
                 0.15/0.54 
                 8/26 
               
               
                 SDF-1α/p-Akt 
                 Total Phospho 
                 CCG 
                 0.034 
                 0.077 
                 0.71 
                 0.52/1.04 
                 8/26 
               
               
                 SDF-1α/p-Erk 
                 Total Phospho 
                 CCG 
                 0.053 
                 0.043 
                 0.74 
                 1.75/2.27 
                 8/26 
               
               
                 Thapsigargin/p-CREB 
                 Total Phospho 
                 CCG 
                 0.025 
                 0.015 
                 0.78 
                 1.79/2.77 
                 8/26 
               
               
                 Thapsigargin/p-S6 
                 Fold 
                 CCG 
                 0.018 
                 0.051 
                 0.73 
                 0.03/0.31 
                 8/26 
               
               
                 Thapsigargin/p-S6 
                 Total Phospho 
                 CCG 
                 0.028 
                 0.070 
                 0.72 
                 0.31/0.67 
                 8/26 
               
               
                   
               
               
                 Table is sorted alphabetically by node 
               
               
                 Node/metrics with a t-test p value or Wilcoxon p value of ≦0.5 and an AUC of ≧.66 are shown 
               
               
                 Negative mean CR/NR values represent down regulation as compared to reference/control/normalization 
               
               
                 Metrics are defined in Materials and Methods 
               
               
                 Abbreviations are defined in Table 17 
               
            
           
         
       
     
     d) Correlations Between Nodes/Metric Combinations. 
     Although nodes were analyzed independently in the primary analysis, several of the top-ranking node/metric combinations appeared to be correlated with each other. The correlations between nodes were studied for modulated signaling and surface marker levels. The Pearson correlation coefficients using the fold metrics were computed for all nodes with an AUC of the ROCs &gt;0.66 and p≦0.05 to evaluate correlations of induced signaling. The heat map of the pair wise correlation matrix (not shown) demonstrates that some nodes, often mapping in the same pathway, such as IL3/p-Stat1 and IL3/p-Stat3, and Flt3L/p-Akt and Flt3L/p-S6 were highly correlated. Other nodes such as SCF/p-Akt and IL-3/Stat3 were independent of each other, suggesting that they may be combined to compute a multivariate model with higher predictive value. Notably, comparison of Flt3R and c-KitR expression levels to their ligand-activated pathway readouts demonstrated a poor correlation (i.e. &lt;0.5 correlation coefficient, not shown). These data underscore the additive value of measuring the modulated signaling activity compared to measuring expression level of the surface receptors associated with that specific pathway. 
     e) Combination of Nodes. 
     To evaluate nodes that might provide a superior stratification when combined with each other, all node/metrics with an AUC greater than or equal to 0.66 were chosen to be part of combination analysis. There were 4465 possible two-node/metric combinations and 138415 possible three-node combinations. Combinations that had a minimum distance AUC greater than the best single node/metric (AUC=0.90) were analyzed further. Table 24 provides as list of nodes that appear most frequent (&gt;3%) among the two or three node/metric combinations. All triplets of nodes with a minimum distance AUC great than 0.95 were also analyzed using the bootstrap procedure described in material and methods. Bootstrapping analysis ( FIG. 9C ) suggested that some of these combinations might be more robust in distinguishing CRs from the NRs (e.g. SDF1α/p-Akt/Fold with IL-27/p-Stat3/TotalPhospho and etoposide/p-Chk2−, c-PARP+/Quad). While no restrictions were placed on the nodes chosen for each combination, several of the highest ranking combinations contained nodes from multiple biological pathways. 
     
       
         
           
               
             
               
                 TABLE 24 
               
             
            
               
                   
               
               
                 List of Unique Nodes in Combinations for Study No. 1. 
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                   
                   
                   
                 Frequency  
                   
                 Frequency  
                   
                 AUC  
               
               
                 Node  
                   
                   
                 of Node in 
                 Best AUC in 
                 of Node in 
                 Best AUC in 
                 of 
               
               
                 included in any  
                   
                 Biological 
                 Two-Node 
                 Two-Node 
                 Three-Node 
                 Three Node 
                 Single 
               
               
                 Combination Model 
                 Metric 
                 Category 
                 Combinations 
                 Combination 
                 Combinations 
                 Combinations 
                 Node 
               
               
                   
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                 cKit 
                 Rel.  
                 Surface  
                 17.07 
                 0.98 
                 17.5 
                 1.00 
                 0.78 
               
               
                   
                 Expression 
                 Marker 
                   
                   
                   
                   
                   
               
               
                 IL-27/p-Stat3 
                 TotalPhospho 
                 CCG 
                 25.00 
                 0.97 
                 15.24 
                 1.00 
                 0.90 
               
               
                 IL-3/p-Creb 
                 TotalPhospho 
                 CCG 
                 9.15 
                 0.96 
                 10.05 
                 1.00 
                 0.84 
               
               
                 IGF-1/p-Plcγ2 
                 TotalPhospho 
                 CCG 
                 8.54 
                 0.95 
                 9.28 
                 1.00 
                 0.81 
               
               
                 ABCG2 
                 Percent Pos. 
                 Surface  
                 7.93 
                 0.97 
                 9.26 
                 1.00 
                 0.76 
               
               
                   
                   
                 Marker 
                   
                   
                   
                   
                   
               
               
                 cKit 
                 Percent Pos. 
                 Surface  
                 5.49 
                 0.94 
                 7.97 
                 1.00 
                 0.71 
               
               
                   
                   
                 Marker 
                   
                   
                   
                   
                   
               
               
                 GM-CSF/p-Stat3 
                 TotalPhospho 
                 CCG 
                 5.49 
                 0.92 
                 7.42 
                 1.00 
                 0.81 
               
               
                 FLT3R 
                 Rel.  
                 Surface  
                 6.10 
                 0.94 
                 6.45 
                 1.00 
                 0.82 
               
               
                   
                 Expression 
                 Marker 
                   
                   
                   
                   
                   
               
               
                 IL-6/p-Stat3 
                 TotalPhospho 
                 CCG 
                 2.44 
                 0.93 
                 6.37 
                 1.00 
                 0.77 
               
               
                 IFNγ/p-Stat3 
                 TotalPhospho 
                 CCG 
                 7.32 
                 0.95 
                 5.85 
                 1.00 
                 0.83 
               
               
                 FLT3R 
                 TotalPhospho 
                 Surface  
                 3.66 
                 0.95 
                 5.76 
                 0.98 
                 0.77 
               
               
                   
                   
                 Marker 
                   
                   
                   
                   
                   
               
               
                 Etoposide/p-Chk2−,  
                 Quad 
                 Apoptosis 
                 4.88 
                 0.95 
                 5.71 
                 1.00 
                 0.81 
               
               
                 c-PARP+ 
                   
                   
                   
                   
                   
                   
                   
               
               
                 Etoposide &amp; ZVAD/ 
                 Quad 
                 Apoptosis 
                 4.88 
                 0.97 
                 5.61 
                 1.00 
                 0.83 
               
               
                 p-Chk2−, c-PARP+ 
                   
                   
                   
                   
                   
                   
                   
               
               
                 SCF/p-Akt 
                 Fold 
                 CCG 
                 4.88 
                 0.95 
                 5.40 
                 1.00 
                 0.81 
               
               
                 SCF/p-Erk 
                 Fold 
                 CCG 
                 3.05 
                 0.92 
                 5.06 
                 1.00 
                 0.73 
               
               
                 Etoposide/c-PARP 
                 TotalPhospho 
                 Apoptosis 
                 2.44 
                 0.95 
                 4.96 
                 1.00 
                 0.71 
               
               
                 Etoposide/BCL2 
                 Fold 
                 Apoptosis 
                 4.27 
                 0.93 
                 4.87 
                 1.00 
                 0.70 
               
               
                 IL-27/p-Stat5 
                 TotalPhospho 
                 CCG 
                 1.83 
                 0.93 
                 4.82 
                 1.00 
                 0.66 
               
               
                 FLT3L/p-Creb 
                 TotalPhospho 
                 CCG 
                 4.27 
                 0.98 
                 4.62 
                 1.00 
                 0.78 
               
               
                 none/p-Stat3 
                 Basal 
                 CCG 
                 3.05 
                 0.93 
                 4.60 
                 1.00 
                 0.81 
               
               
                 IFNα/p-Stat1 
                 Fold 
                 CCG 
                 2.44 
                 0.96 
                 4.38 
                 1.00 
                 0.75 
               
               
                 Etoposide &amp; ZVAD/ 
                 TotalPhospho 
                 Apoptosis 
                 3.05 
                 0.94 
                 4.18 
                 1.00 
                 0.76 
               
               
                 c-Caspase3 
                   
                   
                   
                   
                   
                   
                   
               
               
                 Eloposide/p-Chk2 
                 Fold 
                 Apoptosis 
                 1.83 
                 0.94 
                 4.05 
                 1.00 
                 0.73 
               
               
                 none/p-Creb 
                 Basal 
                 CCG 
                 5.49 
                 0.93 
                 3.94 
                 0.98 
                 0.87 
               
               
                 EPO/p-Stat3 
                 TotalPhospho 
                 CCG 
                 4.88 
                 0.95 
                 3.91 
                 0.98 
                 0.84 
               
               
                 IL-3/p-Stat3 
                 TotalPhospho 
                 CCG 
                 2.44 
                 0.92 
                 3.83 
                 0.99 
                 0.69 
               
               
                 FLT3L/p-Akt 
                 Fold 
                 CCG 
                 5.49 
                 0.96 
                 3.59 
                 0.99 
                 0.82 
               
               
                 Etoposide/p-Chk2+,  
                 Quad 
                 Apoptosis 
                 1.83 
                 0.93 
                 3.57 
                 1.00 
                 0.74 
               
               
                 c-PARp− 
                   
                   
                   
                   
                   
                   
                   
               
               
                 H 2 O 2 /p-Lck 
                 Fold 
                 CCG 
                 1.83 
                 0.93 
                 3.56 
                 1.00 
                 0.75 
               
               
                 IGF-1/p-Creb 
                 TotalPhospho 
                 CCG 
                 2.44 
                 0.95 
                 3.52 
                 1.00 
                 0.82 
               
               
                 FLT3L/p-Erk 
                 Fold 
                 CCG 
                 1.22 
                 0.92 
                 3.44 
                 1.00 
                 0.72 
               
               
                 Thapsigargin/p-Creb 
                 TotalPhospho 
                 CCG 
                 1.22 
                 0.90 
                 3.42 
                 1.00 
                 0.75 
               
               
                 IL-10/p-Stat3 
                 TotalPhospho 
                 CCG 
                 4.88 
                 0.94 
                 3.41 
                 0.98 
                 0.84 
               
               
                 CD40L/p-Creb 
                 TotalPhospho 
                 CCG 
                 1.83 
                 0.92 
                 3.24 
                 0.98 
                 0.83 
               
               
                 ABCG2 
                 Rel. 
                 Surface  
                 1.22 
                 0.93 
                 3.20 
                 1.00 
                 0.70 
               
               
                   
                 Expression 
                 Marker 
                   
                   
                   
                   
                   
               
               
                 none/p-Chk2−,  
                 Quad 
                 Apoptosis 
                 1.22 
                 0.93 
                 3.19 
                 1.00 
                 0.69 
               
               
                 c-PARP+ 
               
               
                   
               
               
                 All unique nodes with a minimum frequency of 3% are shown and table is sorted by frequency. 
               
               
                 Metrics are defined in Materials and Methods 
               
               
                 Abbreviations are defined in Table 17 
               
            
           
         
       
     
     Second Study: 
     The second study was performed to assess whether the stratifying signaling profiles developed from the first study could be extrapolated to a fully independent set of AML samples obtained from a different center. In this sample set, 90 nodes were assessed for association with clinical response to standard and high-dose AML induction therapy using the same metrics as the first study. Eighty-seven of the nodes overlapped with the first study (Table 17). Of these, 21 node/metrics were selected for the primary endpoint analysis based on a multistep selection process that considered univariate stratification power, reproducibility (when available), node combination analysis and minimum representation in the four biological categories relevant to AML disease pathophysiology. 
     a) Patient and Sample Characteristics. 
     Of the 134 cryopreserved AML BMMC samples in the study, 46 samples were not evaluable due to insufficient viable cells after thawing. In addition, due to the low recovery of viable cells after thawing, the number of cells per sample varied and many samples did not yield enough cells to analyze all planned nodes (Table 17). Both the original 134 and the analyzed sample set in this study (n=88) were representative of the United States AML patient population and response rates, except for an over-representation of female gender and younger age at diagnosis (Table 16 and Table 19). As expected, age, cytogenetic groups and secondary malignancies were statistically associated with response to induction therapy (Table 16). 
     b) Univariate Analysis of Pre-Specified 21 Node/Metric Selected from the First Study (Primary Endpoint). 
     Univariate analysis, unadjusted for multiple testing, was performed on the 21 pre-specified node/metrics selected for their performance in the first study, and ranked by p-value (Table 25). Based on this analysis, only two node/metric combinations, PMA/p-Erk Fold, and IL-27/p-Stat3 TotalPhoshpo had AUCs of the ROC above 0.66 (0.67 and 0.68, respectively) and ap value ≦0.05 (0.047 and 0.048, respectively) in stratifying patients for response to induction therapy. Therefore, no further analysis using these 21 pre-specified node/metrics combinations was performed. 
     
       
         
           
               
             
               
                 TABLE 25 
               
             
            
               
                   
               
               
                 Extrapolation of Univariate Analysis for 21 Node/Metrics from Study No. 1 to Study No. 2 
               
               
                 (Primary Endpoint Analysis No. 2) 
               
            
           
           
               
               
               
               
               
               
               
               
               
               
               
            
               
                 Node:  
                   
                   
                 Num. 
                 AUC  
                   
                   
                 Num.  
                 AUC  
                   
                   
               
               
                 Modulator/ 
                   
                 Biological 
                 CRs/ 
                 of 
                 t-test  
                 Wilcoxon  
                 CRs/ 
                 of  
                 t-test  
                 Wikoxon  
               
               
                 Read-Out 
                 Metric 
                 Category 
                 NRs 1 
                 ROC 1 
                 P 1 
                 Test P1 
                 NRs 2 
                 ROC 2 
                 P2 
                 Test P2 
               
               
                   
               
            
           
           
               
               
               
               
               
               
               
               
               
               
               
            
               
                 PMA/p-ERK 
                 Fold 
                 CCG 
                 9/25 
                 0.70 
                 0.063 
                 0.079 
                 33/9  
                 0.67 
                 0.047 
                 0.135 
               
               
                 IL-27/p-Stat3 
                 TotalPhospho 
                 CCG 
                 9/25 
                 0.90 
                 &lt;0.001 
                 &lt;0.001 
                 44/13 
                 0.68 
                 0.073 
                 0.048 
               
               
                 H 2 O 2 /p-PLCγ2 
                 Fold 
                 Phosphatase 
                 7/22 
                 0.75 
                 0.097 
                 0.055 
                 48/19 
                 0.56 
                 0.454 
                 0.427 
               
               
                 ABCG2 
                 PercentPos 
                 Surface 
                 8/23 
                 0.76 
                 0.009 
                 0.034 
                 37/11 
                 0.55 
                 0.516 
                 0.646 
               
               
                   
                   
                 Marker 
                   
                   
                   
                   
                   
                   
                   
                   
               
               
                 FLT3R 
                 Rel.  
                 Surface 
                 8/23 
                 0.82 
                 0.004 
                 0.006 
                 40/11 
                 0.62 
                 0.609 
                 0.233 
               
               
                   
                 Expression 
                 Marker 
                   
                   
                   
                   
                   
                   
                   
                   
               
               
                 H 2 O 2 /p-SLP 76 
                 Fold 
                 Phosphatase 
                 7/22 
                 0.78 
                 0.024 
                 0.028 
                 48/18 
                 0.59 
                 0.287 
                 0.238 
               
               
                 SCF/p-Akt 
                 Fold 
                 CCG 
                 9/25 
                 0.81 
                 0.018 
                 0.007 
                 51/24 
                 0.60 
                 0.081 
                 0.178 
               
               
                 CKit 
                 Rel.  
                 Surface 
                 8/23 
                 0.78 
                 0.012 
                 0.018 
                 40/11 
                 0.55 
                 0.498 
                 0.660 
               
               
                   
                 Expression 
                 Marker 
                   
                   
                   
                   
                   
                   
                   
                   
               
               
                 FLT3L/p-Akt 
                 Fold 
                 CCG 
                 9/25 
                 0.82 
                 0.003 
                 0.004 
                 52/26 
                 0.50 
                 0.555 
                 0.962 
               
               
                 IFNα/p-Stat1 
                 Fold 
                 CCG 
                 9/25 
                 0.75 
                 0.017 
                 0.030 
                 35/11 
                 0.56 
                 0.590 
                 0.542 
               
               
                 none/p-PLCγ2 
                 Basal 
                 CCG 
                 9/25 
                 0.79 
                 0.008 
                 0.009 
                 47/16 
                 0.55 
                 0.666 
                 0.526 
               
               
                 Etoposide/p-Chk2−,  
                 Quadrant 
                 Apoptosis 
                 7/22 
                 0.81 
                 0.010 
                 0.015 
                 43/19 
                 0.57 
                 0.425 
                 0.396 
               
               
                 c-PARP+ 
                   
                   
                   
                   
                   
                   
                   
                   
                   
                   
               
               
                 none/p-ERK 
                 Basal 
                 CCG 
                 9/25 
                 0.77 
                 0.028 
                 0.015 
                 46/16 
                 0.54 
                 0.491 
                 0.658 
               
               
                 none/p-Stat3 
                 Basal 
                 CCG 
                 9/25 
                 0.81 
                 0.005 
                 0.005 
                 47/16 
                 0.53 
                 0.738 
                 0.722 
               
               
                 none/p-CREB 
                 Basal 
                 CCG 
                 9/25 
                 0.87 
                 0.001 
                 0.001 
                 47/16 
                 0.51 
                 0.929 
                 0.882 
               
               
                 GCSF/p-Stat3 
                 Fold 
                 CCG 
                 9/25 
                 0.68 
                 0.091 
                 0.111 
                 47/17 
                 0.51 
                 0.974 
                 0.951 
               
               
                 SDF-1α/p-Akt 
                 Fold 
                 CCG 
                 9/25 
                 0.71 
                 0.025 
                 0.067 
                 39/22 
                 0.59 
                 0.293 
                 0.273 
               
               
                 G CSF/p-Stat5 
                 Fold 
                 CCG 
                 9/25 
                 0.71 
                 0.038 
                 0.072 
                 47/17 
                 0.53 
                 0.868 
                 0.721 
               
               
                 SCF/p-56 
                 Fold 
                 CCG 
                 9/25 
                 0.66 
                 0.055 
                 0.163 
                 50/24 
                 0.51 
                 0.852 
                 0.922 
               
               
                 Thapsigargin/p-S6 
                 Fold 
                 CCG 
                 9/25 
                 0.70 
                 0.021 
                 0.076 
                 32/11 
                 0.51 
                 0.684 
                 0.902 
               
               
                 FLT3L/p-S6 
                 Fold 
                 CCG 
                 9/25 
                 0.66 
                 0.026 
                 0.154 
                 51/26 
                 0.51 
                 0.889 
                 0.842 
               
               
                   
               
               
                 Metrics are defined in Materials and Methods 
               
               
                 Abbreviations are defined in Table 17 
               
            
           
         
       
     
     c) Univariate Analysis of all Nodes/Metric Combinations (Secondary Endpoint). 
     Univariate analysis, unadjusted for multiple testing, was performed testing all 182 node-metric combinations and ranking them by the resulting AUC of the ROCs. Seventeen node-metrics met the cutoff criteria (i.e. AUC values above 0.66 with a p value ≦0.05; Table 26). This number was lower than expected based on the results of the first study but higher than expected by chance. 
     
       
         
           
               
             
               
                 TABLE 26 
               
             
            
               
                   
               
               
                 Univariate Analysis of Node/Metrics for All Patients in Study No. 2 
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                 Node:  
                   
                   
                 Num. 
                 AUC 
                   
                   
                 Mean  
               
               
                 Modulator/ 
                   
                 Biological 
                 CRs/ 
                 of 
                 t-test  
                 Wilcoxon 
                 Value 
               
               
                 Read-Out 
                 Metric 
                 Category 
                 NRs 
                 ROC 
                 P 
                 P 
                 CRs/NRs 
               
               
                   
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                 Ara-C &amp; Dauno/ 
                 Fold 
                 Apoptosis 
                 35/11 
                 0.67 
                 0.042 
                 0.089 
                 1.99/0.82 
               
               
                 c-PARP 
                   
                   
                   
                   
                   
                   
                   
               
               
                 Etoposide/c-PARP 
                 Fold 
                 Apoptosis 
                 58/29 
                 0.66 
                 0.023 
                 0.016 
                 0.79/0.25 
               
               
                 H 2 O 2 /p-Akt 
                 Fold 
                 Phosphatase 
                 48/19 
                 0.66 
                 0.065 
                 0.044 
                 0.68/0.91 
               
               
                 IFNγ/p-Stat3 
                 Fold 
                 CCG 
                 16/5  
                 0.83 
                 0.021 
                 0.032 
                 −0.02/0.2    
               
               
                 IL-10/p-Stat3 
                 Fold 
                 CCG 
                 19/5  
                 0.84 
                 0.012 
                 0.023 
                 0.08/0.39 
               
               
                 IL-10/p-Stat5 
                 Fold 
                 CCG 
                 19/5  
                 0.80 
                 0.011 
                 0.044 
                 0.09/0.43 
               
               
                 IL-27/p-Stat1 
                 TotalPhospho 
                 CCG 
                 44/13 
                 0.74 
                 0.012 
                 0.009 
                 1.66/2.63 
               
               
                 IL-27/p-Stat3 
                 Fold 
                 CCG 
                 44/14 
                 0.71 
                 0.032 
                 0.019 
                 0.22/0.58 
               
               
                 IL-27/p-Stat3 
                 TotalPhospho 
                 CCG 
                 44/13 
                 0.68 
                 0.073 
                 0.048 
                 1.88/2.43 
               
               
                 IL-3/p-Stat5 
                 Fold 
                 CCG 
                 9/5 
                 0.78 
                 0.022 
                 0.112 
                 1.99/0.44 
               
               
                 IL-6/p-Stat1 
                 Fold 
                 CCG 
                 10/5  
                 0.94 
                 0.034 
                 0.005 
                 −0.01/0.26   
               
               
                 IL-6/p-Stat3 
                 Fold 
                 CCG 
                 10/5  
                 0.86 
                 0.069 
                 0.032 
                 0.12/1.09 
               
               
                 IL-6/p-Stat3 
                 TotalPhospho 
                 CCG 
                 10/5  
                 0.88 
                 0.083 
                 0.019 
                 1.76/2.98 
               
               
                 IL-6/p-Stat5 
                 Fold 
                 CCG 
                 10/5  
                 0.90 
                 0.008 
                 0.013 
                 0.13/0.55 
               
               
                 none/p-Erk 
                 Basal 
                 CCG 
                 33/9  
                 0.66 
                 0.026 
                 0.152 
                 1.05/2.14 
               
               
                 PMA/P-Erk 
                 Fold 
                 CCG 
                 33/9  
                 0.67 
                 0.047 
                 0.135 
                 2.82/1.74 
               
               
                 Thapsigargin/p-Erk 
                 Fold 
                 CCG 
                 31/9  
                 0.68 
                 0.014 
                 0.112 
                 1.22/0.36 
               
               
                   
               
               
                 Table is sorted alphabetically by node 
               
               
                 Node/metrics with a t-test p value or Wilcoxon p value of ≦0.5 and an AUC of ≧.66 are shown 
               
               
                 Negative mean CR/NR values represent down regulation as compared to reference/control/normalization 
               
               
                 Metrics are defined in Materials and Methods 
               
               
                 Abbreviations are defined in Table 17 
               
            
           
         
       
       
      
      
     
     We hypothesized that this was a consequence of the higher heterogeneity in demographic and base line characteristic present in this sample set, compared to the first study (Table 16), suggesting the need to examine the data using clinical covariates. 
     d) Nodes Associated with Disease Response to Induction Chemotherapy in Patient Subsets as Defined by Clinical Covariates. 
     1. Age: 
     Age, a covariate known to be associated with clinical outcomes in AML, was independently used to test the node/metric combinations for their association with clinical response to induction therapy. Using age as a dichotomous criteria (&lt;60 versus ≧60 years), 28 node/metrics stratified patients for response to induction therapy in the &lt;60 years patient group (Table 28B, versus Table 28A for patients 60 and older). Despite the small sample set (n˜20), analysis of the older patient cohort samples also revealed unique nodes that distinguished CR from NR samples in this study (Table 28A). These included FLT3L induced increase in p-Erk and p-Akt and H 2 O 2  induced increase in p-AKT and p-PLCγ2. Since H 2 O 2  is a tyrosine phosphatase inhibitor increases in p-AKT and p-PLCγ2 following H 2 O 2  treatment (phosphatase inhibition) in NR samples, suggests altered phosphatase activity may be associated with refractory disease in older patients. Furthermore, incorporation of age as a clinical variable in combination with specific nodes (e.g. IL-27/p-Stat3) increased the predictive value of either age or the node itself, demonstrating the ability of multiparameter flow cytometry to improve on age, an important clinical prognostic indicator for response to induction chemotherapy (not shown). 
     
       
         
           
               
             
               
                 TABLE 28 
               
               
                   
               
               
                 Univariate Analysis of Node/Metrics for Study No. 2 within Age Sub-Groups 
               
               
                   
               
             
            
               
                 Table 28A: Patients age 60 and older 
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                 Node:  
                   
                 Biological 
                 Num. 
                 AUC of 
                   
                 Wilcoxon 
                 Mean Value 
               
               
                 Modulator/Read-Out 
                 Metric 
                 Category 
                 CRs/NRs 
                 ROC 
                 t-test P 
                 P 
                 of CRs/NRs 
               
               
                   
               
               
                 FLT3L/p-Akt 
                 Fold 
                 CCG 
                  7/14 
                 0.85 
                 0.011 
                 0.010 
                 0.00/0.36 
               
               
                 FLT3L/p-Erk 
                 Fold 
                 CCG 
                  6/14 
                 0.77 
                 0.034 
                 0.062 
                 0.01/0.21 
               
               
                 FLT3L/p-S6 
                 Fold 
                 CCG 
                  6/14 
                 0.80 
                 0.004 
                 0.041 
                 −0.06/0.67   
               
               
                 H 2 O 2 /p-Akt 
                 Fold 
                 Phosphatase 
                 7/9 
                 0.78 
                 0.029 
                 0.071 
                 0.45/0.88 
               
               
                 H 2 O 2 /p-Akt 
                 TotalPhospho 
                 Phosphatase 
                 7/9 
                 0.79 
                 0.026 
                 0.055 
                 0.84/1.33 
               
               
                 H 2 O 2 /p-Plcγ2 
                 TotalPhospho 
                 Phosphatase 
                 7/9 
                 0.84 
                 0.013 
                 0.023 
                 1.19/1.86 
               
               
                 IL-27/p-Stat3 
                 Fold 
                 CCG 
                 6/8 
                 0.83 
                 0.091 
                 0.043 
                 −0.19/0.48   
               
               
                 LPS/p-Erk 
                 Fold 
                 CCG 
                 2/5 
                 1.00 
                 0.026 
                 0.095 
                 −0.33/−0.16 
               
               
                 SCF/p-S6 
                 Fold 
                 CCG 
                  6/13 
                 0.74 
                 0.030 
                 0.106 
                 0.14/0.70 
               
               
                   
               
            
           
           
               
            
               
                 Table 28B: Patients Less than 60 Years old 
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                 Node:  
                   
                 Biological 
                 Num. 
                 AUC of 
                   
                 Wilcoxon 
                 Mean Value 
               
               
                 Modulator/Read-Out 
                 Metric 
                 Category 
                 CRs/NRs 
                 ROC 
                 t-test P 
                 P 
                 of CRs/NRs 
               
               
                   
               
               
                 Ara-C &amp; Dauno/ 
                 Quad 
                 Apoptosis 
                 29/4  
                 0.85 
                 0.001 
                 0.021 
                 23.35/7.48  
               
               
                 p-Chk2−, c-PARP+ 
                   
                   
                   
                   
                   
                   
                   
               
               
                 Etoposide/c-PARP 
                 Fold 
                 Apoptosis 
                 49/14 
                 0.74 
                 0.115 
                 0.007 
                 0.89/0.28 
               
               
                 Etoposide/p-Chk2−,  
                 Quad 
                 Apoptosis 
                 39/7  
                 0.72 
                 0.010 
                 0.071 
                 21.17/9.58  
               
               
                 c-PARP+ 
                   
                   
                   
                   
                   
                   
                   
               
               
                 GM-CSF/p-Stat3 
                 TotalPhospho 
                 CCG 
                 8/2 
                 1.00 
                 0.069 
                 0.044 
                 1.51/2.35 
               
               
                 IFNα/p-Stat1 
                 Fold 
                 CCG 
                 33/4  
                 0.75 
                 0.050 
                 0.114 
                 1.72/2.60 
               
               
                 IFNα/p-Stat1 
                 TotalPhospho 
                 CCG 
                 33/4  
                 0.82 
                 0.059 
                 0.039 
                 2.67/3.84 
               
               
                 IFNα/p-Stat3 
                 TotalPhospho 
                 CCG 
                 33/4  
                 0.79 
                 0.014 
                 0.065 
                 2.62/3.44 
               
               
                 IFNγ/p-Stat3 
                 TotalPhospho 
                 CCG 
                 14/2  
                 1.00 
                 &lt;0.001 
                 0.017 
                 1.60/2.71 
               
               
                 IFNγ/p-Stat1 
                 Fold 
                 CCG 
                 14/2  
                 0.96 
                 0.036 
                 0.033 
                 1.35/2.96 
               
               
                 IFNγ/p-Stat1 
                 TotalPhospho 
                 CCG 
                 14/2  
                 0.96 
                 0.163 
                 0.033 
                 2.40/4.13 
               
               
                 IFNγ/p-Stat5 
                 Fold 
                 CCG 
                 14/2  
                 1.00 
                 0.009 
                 0.017 
                 0.68/1.67 
               
               
                 IL-10/p-Stat3 
                 TotalPhospho 
                 CCG 
                 17/2  
                 1.00 
                 0.007 
                 0.012 
                 1.67/2.90 
               
               
                 IL-27/p-Stat1 
                 TotalPhospho 
                 CCG 
                 38/5  
                 0.84 
                 0.048 
                 0.016 
                 1.73/3.12 
               
               
                 IL-27/p-Stat3 
                 Fold 
                 CCG 
                 38/6  
                 0.80 
                 0.080 
                 0.019 
                 0.29/0.72 
               
               
                 IL-27/p-Stat3 
                 TotalPhospho 
                 CCG 
                 38/5  
                 0.83 
                 0.047 
                 0.014 
                 1.97/3.06 
               
               
                 IL-6/p-Stat1 
                 Fold 
                 CCG 
                 9/2 
                 1.00 
                 0.202 
                 0.036 
                 −0.02/0.3    
               
               
                 IL-6/p-Stat3 
                 Fold 
                 CCG 
                 9/2 
                 1.00 
                 0.271 
                 0.036 
                 0.13/1.67 
               
               
                 IL-6/p-Stat3 
                 TotalPhospho 
                 CCG 
                 9/2 
                 1.00 
                 0.172 
                 0.036 
                 1.77/4.10 
               
               
                 IL-6/p-Stat5 
                 Fold 
                 CCG 
                 9/2 
                 0.89 
                 0.003 
                 0.145 
                 0.11/0.58 
               
               
                 MRP-1 
                 PercentPos 
                 Surface  
                 33/4  
                 0.70 
                 0.018 
                 0.222 
                 33.19/14.20 
               
               
                   
                   
                 Markers 
                   
                   
                   
                   
                   
               
               
                 none/c-PARP 
                 TotalPhospho 
                 Apoptosis 
                 14/2  
                 0.96 
                 0.305 
                 0.033 
                   1.80/−0.35 
               
               
                 none/p-Erk 
                 Basal 
                 CCG 
                 31/3  
                 0.68 
                 0.021 
                 0.348 
                 0.98/1.96 
               
               
                 PMA/p-CREB 
                 Fold 
                 CCG 
                 33/4  
                 0.82 
                 0.003 
                 0.039 
                 0.78/1.55 
               
               
                 PMA/p-CREB 
                 TotalPhospho 
                 CCG 
                 33/4  
                 0.84 
                 0.002 
                 0.025 
                 3.72/5.00 
               
               
                 Staurosporine &amp; ZVAD/ 
                 TotalPhospho 
                 Apoptosis 
                 10/2  
                 1.00 
                 0.107 
                 0.030 
                 6.40/8.27 
               
               
                 Cytochrome-C 
                   
                   
                   
                   
                   
                   
                   
               
               
                 Staurosporine/c-PARP 
                 Fold 
                 Apoptosis 
                 6/2 
                 1.00 
                 0.036 
                 0.171 
                 3.47/7.06 
               
               
                 Thapsigargin/p-CREB 
                 TotalPhospho 
                 CCG 
                 30/4  
                 0.83 
                 0.024 
                 0.031 
                 2.83/3.71 
               
               
                 Thapsigargin/p-Erk 
                 Fold 
                 CCG 
                 29/3  
                 0.67 
                 0.019 
                 0.365 
                 1.28/0.40 
               
               
                   
               
               
                 Node/metrics with a t-test p value or Wilcoxon p value of ≦.05 and an AUC of ≧.66 are shown. 
               
               
                 Metrics are defined in Materials and Methods 
               
               
                 Abbreviations are defined in Table 17 
               
            
           
         
       
     
     2. Presence or Absence of Secondary AML: 
     Due to overlapping baseline disease characteristics of the groups when stratified by age versus presence/absence of secondary AML, the univariate analysis of samples group resulted in similar stratifying nodes (Tables 28 and 29). This suggests that at least in this sample set, age at diagnosis can be considered a surrogate marker for different disease biology. When age was examined as a variable across the secondary AML sample subset no correlation between age and response to therapy was found ( FIG. 9 ), suggesting that the underlying biology of secondary AML is different from that of de novo AML, and age is not prognostic for response in secondary AML. 
     
       
         
           
               
             
               
                 TABLE 29 
               
               
                   
               
               
                 Univariate Analysis of Node/Metrics for Study No. 2 within De Novo and Secondary AML Sub-Groups 
               
               
                   
               
             
            
               
                 Table 29A: Patients with De Novo AML 
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                 Node:  
                   
                 Biologic 
                 Num. 
                 AUC of 
                   
                 Wilcoxon 
                 Mean Value 
               
               
                 Modulator/Read-out 
                 Metric 
                 Category 
                 CRs/NRs 
                 ROC 
                 t-test P  
                 P 
                 of CRs/NRs 
               
               
                   
               
               
                 Etoposide/p-Chk2 
                 Fold 
                 Apoptosis 
                 46/14 
                 0.67 
                 0.033 
                 0.058 
                 0.59/0.27 
               
               
                 FLT3L/p-PLCy2 
                 TotalPhospho 
                 CCG 
                 4/3 
                 1.00 
                 0.023 
                 0.057 
                 1.26/1.95 
               
               
                 GM-CSF/pStat3 
                 TotalPhospho 
                 CCG 
                 8/4 
                 0.97 
                 0.007 
                 0.008 
                 1.51/2.22 
               
               
                 IFNγ/p-Stat3 
                 Fold 
                 CCG 
                 14/4  
                 0.89 
                 0.014 
                 0.018 
                 −0.04/0.24   
               
               
                 IFNγ/p-Stat3 
                 TotalPhospho 
                 CCG 
                 14/4  
                 0.89 
                 0.026 
                 0.018 
                 1.59/2.48 
               
               
                 IL-10/p-Stat3 
                 Fold 
                 CCG 
                 17/4  
                 0.93 
                 0.005 
                 0.011 
                 0.05/0.45 
               
               
                 IL-10/p-Stat3 
                 TotalPhospho 
                 CCG 
                 17/4  
                 0.93 
                 0.014 
                 0.006 
                 1.63/2.68 
               
               
                 IL-10/p-Stat5 
                 Fold 
                 CCG 
                 17/4  
                 0.84 
                 0.027 
                 0.04 
                 0.06/0.43 
               
               
                 IL-3/p-Stat1 
                 TotalPhospho 
                 CCG 
                 8/4 
                 0.88 
                 0.040 
                 0.048 
                 1.03/1.71 
               
               
                 IL-3/p-Stat3 
                 TotalPhospho 
                 CCG 
                 8/4 
                 0.88 
                 0.134 
                 0.048 
                 1.46/2.40 
               
               
                 IL-3/p-Stat5 
                 Fold 
                 CCG 
                 8/4 
                 0.78 
                 0.048 
                 0.154 
                 1.87/0.39 
               
               
                 IL-6/p-Stat1 
                 Fold 
                 CCG 
                 8/4 
                 0.91 
                 0.088 
                 0.028 
                 0.00/0.19 
               
               
                 IL-6/p-Stat1 
                 TotalPhospho 
                 CCG 
                 8/4 
                 0.88 
                 0.026 
                 0.048 
                 1.06/1.67 
               
               
                 IL-6/p-Stat3 
                 TotalPhospho 
                 CCG 
                 8/4 
                 0.91 
                 0.092 
                 0.028 
                 1.77/3.22 
               
               
                 IL-6/p-Stat5 
                 Fold 
                 CCG 
                 8/4 
                 0.88 
                 0.023 
                 0.048 
                 0.12/0.47 
               
               
                 none/p-Erk 
                 Basal 
                 CCG 
                 30/6  
                 0.78 
                 0.015 
                 0.029 
                 0.97/2.48 
               
               
                 none/p-Stat6 
                 Basal 
                 CCG 
                 16/4  
                 0.88 
                 0.077 
                 0.026 
                 1.02/1.34 
               
               
                 SCF/p-Akt 
                 Fold 
                 CCG 
                 44/11 
                 0.76 
                 0.001 
                 0.008 
                   0.52/−0.20 
               
               
                 SCF/p-PLCy2 
                 TotalPhospho 
                 CCG 
                 4/3 
                 1.00 
                 0.037 
                 0.057 
                 1.29/1.96 
               
               
                 SCF/p-S6 
                 Fold 
                 CCG 
                 43/11 
                 0.67 
                 0.013 
                 0.098 
                 1.05/0.43 
               
               
                 SDF-1α/p-CREB 
                 TotalPhospho 
                 CCG 
                 26/3  
                 0.87 
                 0.115 
                 0.037 
                 3.13/1.92 
               
               
                 Stauro &amp; ZVAD/ 
                 TotalPhospho 
                 Apoptosis 
                 10/4  
                 0.90 
                 0.092 
                 0.024 
                 6.40/8.04 
               
               
                 Cytochrome C 
                   
                   
                   
                   
                   
                   
                   
               
               
                 Thapsigargin/p-Erk 
                 Fold 
                 CCG 
                 28/6  
                 0.74 
                 0.010 
                 0.067 
                 1.28/0.27 
               
               
                   
               
            
           
           
               
            
               
                 Table 29B: Patients with Secondary AML 
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                 Node:  
                   
                 Biologic 
                 Num. 
                 AUC of 
                   
                 Wilcoxon 
                 Mean Value 
               
               
                 Modulator/Read-out 
                 Metric 
                 Category 
                 CRs/NRs 
                 ROC 
                 t-test P  
                 P 
                 of CRs/NRs 
               
               
                   
               
               
                 Etoposide/p-Chk2−,  
                 Quad 
                 Apoptosis 
                 8/9 
                 0.83 
                 0.026 
                 0.021 
                 32.71/13.24 
               
               
                 c-PARP+ 
                   
                   
                   
                   
                   
                   
                   
               
               
                 Etoposide/p-Chk2+,  
                 Quad 
                 Apoptosis 
                 8/9 
                 0.85 
                 0.012 
                 0.015 
                 20.98/55.02 
               
               
                 c-PARP− 
                   
                   
                   
                   
                   
                   
                   
               
               
                 FLT3L/p-Akt 
                 Fold 
                 CCG 
                  8/13 
                 0.77 
                 0.025 
                 0.045 
                 0.19/0.60 
               
               
                 FLT3L/p-Erk 
                 Fold 
                 CCG 
                  8/13 
                 0.82 
                 0.004 
                 0.019 
                 0.00/0.32 
               
               
                 FLT3L/p-S6 
                 Fold 
                 CCG 
                  8/13 
                 0.78 
                 0.006 
                 0.037 
                 0.12/1.02 
               
               
                 FLT3R 
                 Rel.  
                 Surface  
                 5/5 
                 0.88 
                 0.042 
                 0.056 
                 1.23/1.10 
               
               
                   
                 Expression 
                 Marker 
                   
                   
                   
                   
                   
               
               
                 G-CSF/p-Stat1 
                 Fold 
                 CCG 
                  6/10 
                 0.75 
                 0.049 
                 0.118 
                 0.00/0.36 
               
               
                 G-CSF/p-Stat3 
                 Fold 
                 CCG 
                  6/10 
                 0.78 
                 0.024 
                 0.073 
                 0.06/0.96 
               
               
                 G-CSF/p-Stat5 
                 Fold 
                 CCG 
                  6/10 
                 0.70 
                 0.044 
                 0.193 
                 0.08/1.07 
               
               
                 G-CSF/p-Stat5 
                 TotalPhospho 
                 CCG 
                 6/9 
                 0.78 
                 0.047 
                 0.088 
                 2.58/3.91 
               
               
                 IFNα/p-Stat1 
                 Fold 
                 CCG 
                 3/5 
                 1.00 
                 0.020 
                 0.036 
                 0.91/2.63 
               
               
                 IFNα/p-Stat1 
                 TotalPhosPho 
                 CCG 
                 3/5 
                 1.00 
                 0.013 
                 0.036 
                 2.01/3.59 
               
               
                 IFNα/p-Stat3 
                 Fold 
                 CCG 
                 3/5 
                 1.00 
                 0.002 
                 0.036 
                 0.23/1.01 
               
               
                 IFNα/p-Stat5 
                 TotalPhospho 
                 CCG 
                 3/5 
                 1.00 
                 0.022 
                 0.036 
                 3.03/4.60 
               
               
                 IL-27/p-Stat1 
                 Fold 
                 CCG 
                 6/8 
                 0.83 
                 0.014 
                 0.043 
                 0.32/1.90 
               
               
                 IL-27/p-Stat1 
                 TotalPhospho 
                 CCG 
                 6/7 
                 0.88 
                 0.013 
                 0.022 
                 1.50/3.19 
               
               
                 IL-27/p-Stat3 
                 Fold 
                 CCG 
                 6/8 
                 0.98 
                 0.001 
                 0.001 
                 −0.01/0.76   
               
               
                 IL-27/p-Stat3 
                 TotalPhospho 
                 CCG 
                 6/7 
                 0.79 
                 0.048 
                 0.101 
                 1.61/2.60 
               
               
                 none/p-Chk2−,  
                 Quad 
                 Apoptosis 
                  7/11 
                 0.81 
                 0.062 
                 0.035 
                 31.05/13.79 
               
               
                 c-PARP+ 
                   
                   
                   
                   
                   
                   
                   
               
               
                 PMA/p-CREB 
                 Fold 
                 CCG 
                 3/5 
                 1.00 
                 0.010 
                 0.036 
                 0.04/1.27 
               
               
                 SCF/p-S6 
                 Fold 
                 CCG 
                  7/13 
                 0.84 
                 0.001 
                 0.014 
                 0.21/1.28 
               
               
                   
               
               
                 Node/metrics with a t-test p value or Wilcoxon p value of ≦.05 and an AUC of ≧.66 are shown 
               
               
                 Negative mean CR/NR values represent down regulation as compared to reference/control/normalization 
               
               
                 Metrics are defined in Materials and Methods 
               
               
                 Abbreviations are defined in Table 17 
               
            
           
         
       
     
     3. Cytogenetics: 
     Since cytogenetic group was a predictive clinical covariate with all patients in the favorable cytogenetic group demonstrating a CR, we evaluated whether nodes could predict response after incorporation of cytogenetic group as a covariate for the patients with intermediate and high-risk cytogenetics. Within the limitations of the small sample set, several nodes, including the IL-27/p-Stat1, p-Stat3 and p-Stat5 nodes, could significantly add to the predictive value of cytogenetic group (Table 30). As expected, FLT3 mutational status was not predictive of response to induction therapy in this data set (Table 16 and Table 31). 
     
       
         
           
               
             
               
                 TABLE 30 
               
             
            
               
                   
               
               
                 Univariate Analysis of Node/Metrics for Study No. 2 for Patients with Intermediate or High 
               
               
                 Risk Cytogenetics with Cytogenetic Group as a Covariate. 
               
            
           
           
               
               
               
               
               
               
               
               
               
               
            
               
                   
                   
                   
                   
                   
                 P value 
                   
                 P Value 
                 AUC  
                 P  
               
               
                 Node:  
                   
                 Biologic 
                 Num. 
                 AUC 
                 for AUC 
                 AUC 
                 for 
                 of 
                 Value 
               
               
                 Modulator/Read-Out 
                 Metric 
                 Category 
                 CRs/NRs 
                 model 
                 model 
                 Cyto 
                 Cyto 
                 Node 
                 Node 
               
               
                   
               
            
           
           
               
               
               
               
               
               
               
               
               
               
            
               
                 Ara-C &amp; Dauno/ 
                 Quad 
                 Apoptosis 
                 29/11 
                 0.74 
                 0.009 
                 0.60 
                 0.042 
                 0.57 
                 0.036 
               
               
                 p-Chk2−, c-PARP− 
                   
                   
                   
                   
                   
                   
                   
                   
                   
               
               
                 H 2 O 2 /p-Akt 
                 Fold 
                 Phosphatase 
                 42/19 
                 0.8 
                 &lt;0.001 
                 0.69 
                 0.022 
                 0.66 
                 0.026 
               
               
                 H 2 O 2 /p-Slp 76 
                 Fold 
                 Phosphatase 
                 42/18 
                 0.78 
                 &lt;0.001 
                 0.72 
                 0.007 
                 0.59 
                 0.071 
               
               
                 IFNγ/p-Stat3 
                 Fold 
                 CCG 
                 16/5  
                 0.84 
                 0.01 
                 0.54 
                 0.532 
                 0.83 
                 0.056 
               
               
                 IL-10/p-Stat3 
                 Fold 
                 CCG 
                 19/5  
                 0.84 
                 0.01 
                 0.55 
                 0.548 
                 0.84 
                 0.058 
               
               
                 IL-27/p-Stat1 
                 TotalPhospho 
                 CCG 
                 39/13 
                 0.81 
                 &lt;0.001 
                 0.66 
                 0.040 
                 0.74 
                 0.019 
               
               
                 IL-27/p-Stat1 
                 Fold 
                 CCG 
                 39/14 
                 0.76 
                 0.002 
                 0.66 
                 0.015 
                 0.66 
                 0.038 
               
               
                 IL-27/p-Stat3 
                 Fold 
                 CCG 
                 39/14 
                 0.81 
                 &lt;0.001 
                 0.66 
                 0.009 
                 0.71 
                 0.010 
               
               
                 IL-27/p-Stat3 
                 TotalPhospho 
                 CCG 
                 39/13 
                 0.76 
                 0.002 
                 0.66 
                 0.024 
                 0.68 
                 0.072 
               
               
                 IL-27/p-Stat5 
                 Fold 
                 CCG 
                 39/14 
                 0.78 
                 0.001 
                 0.66 
                 0.009 
                 0.62 
                 0.041 
               
               
                 IL-27/p-Stat5 
                 TotalPhospho 
                 CCG 
                 38/13 
                 0.76 
                 0.003 
                 0.65 
                 0.032 
                 0.62 
                 0.052 
               
               
                 IL-6/p-Stat5 
                 Fold 
                 CCG 
                 10/5  
                 0.98 
                 0.001 
                 0.60 
                 0.243 
                 0.94 
                 0.089 
               
               
                 SDF-1α/p-CREB 
                 Fold 
                 CCG 
                 33/22 
                 0.74 
                 0.001 
                 0.67 
                 0.090 
                 0.69 
                 0.033 
               
               
                 SDF-1α/p-CREB 
                 TotalPhospho 
                 CCG 
                 26/9  
                 0.84 
                 0.001 
                 0.75 
                 0.023 
                 0.66 
                 0.090 
               
               
                   
               
               
                 Table is sorted alphabetically by node 
               
               
                 Node/metrics with a t-test p value or Wilcoxon p value of ≦.05 and an AUC of ≧.66 are shown 
               
               
                 Metrics are defined in Materials and Methods 
               
               
                 Abbreviations are defined in Supplemental Table 1 
               
            
           
         
       
     
                     TABLE 31                  Demographic and Baseline Characteristics of Intermediate and High Risk Cytogenetic Groups in Study No. 2                                                     Int. Risk   Int. Risk   All Int.   Int. Risk   High Risk   High Risk   All High   High Risk       Characteristic   CRs   NRs   Risk Pts   P-Value   CRs   NRs   Risk Pts.   P-Value                                                                 N   29   9   38       21   22   43           Age (yr)   Median   53.6   59.3   56.1   0.071   51.2   61.7   55.8   0.143           Range   27.0-79.0   45.6-68.6   27.0-79.0       34.8-77.8   25.0-76.3   25.0-77.8           Age Group     &lt;60 yr   26 (90%)   5 (56%)   31 (82%)   0.041   18 (86%)    10 (45%)    28 (65%)    0.01           &gt;=60 yr    3 (10%)   4 (44%)    7 (18%)       3 (14%)   12 (55%)    15 (35%)            Sex   F   17 (59%)   6 (67%)   23 (61%)   1   11 (52%)    10 (45%)    21 (49%)    0.763           M   12 (41%)   3 (33%)   15 (39%)       10 (48%)    12 (55%)    22 (51%)            FAB   M0   0 (0%)   0 (0%)    0 (0%)   0.943   1 (5%)    1 (5%)    2 (5%)    0.831           M1    6 (21%)   1 (11%)    7 (18%)       2 (10%)   0 (0%)    2 (5%)                M2   11 (38%)   4 (44%)   15 (39%)       8 (38%)   10 (45%)    18 (42%)                M4    5 (17%)   2 (22%)    7 (18%)       5 (24%)   6 (27%)   11 (26%)                M5    5 (17%)   2 (22%)    7 (18%)       3 (14%)   2 (9%)    5 (12%)               M6   1 (3%)   0 (0%)    1 (3%)       1 (5%)    2 (9%)    3 (7%)                Other/   1 (3%)   0 (0%)    1 (3%)       1 (5%)    1 (5%)    2 (5%)                Unknown                                       Race   White    7 (24%)   5 (56%)   12 (32%)   0.362   4 (19%)   10 (45%)    14 (33%)    0.141           Other &amp;   22 (76%)   4 (44%)   26 (68%)       17 (81%)    12 (55%)    29 (66%)                Unkitown*                                       FLT3-ITD   Negative   20 (69%)   6 (67%)   26 (68%)   0.821   17 (81%)    17 (77%)    34 (79%)    0.555           Positive    8 (28%)   3 (33%)   11 (29%)       3 (14%)   2 (9%)    5 (12%)               Unknown   1 (3%)   0 (0%)    1 (3%)       1 (5%)    3 (14%)   4 (9%)            Secondary    No   25 (86%)   5 (56%)   30 (79%)   0.071   16 (76%)    9 (41%)   25 (58%)    0.031       AML   Yes    4 (14%)   4 (44%)    8 (21%)       5 (24%)   13 (59%)    18 (42%)            Poor    No   16 (55%)   3 (33%)   19 (50%)   0.252    0 (0%)    0 (0%)    0 (0%)            Prognosis †   Yes   13 (45%)   6 (67%)   19 (50%)       21 (100%)   22 (100%)   43 (100%)           Induction    Fludarabine +   0 (0%)   0 (0%)    0 (0%)   0.492   4 (19%)   2 (9%)    6 (14%)   0.691       Therapy   HDAC                                           IA + Zarnestra   12 (41%)   3 (33%)   15 (39%)       6 (29%)   6 (27%)   12 (28%)                IDA + HDAC   10 (34%)   2 (22%)   12 (32%)       7 (33%)   7 (32%)   14 (33%)                Other   7 (24%)   4 (44%)   11 (29%)       4 (19%)   7 (32%)   11 (26%)                * The “Other” values for race are based on Black, Asian, and Hispanic sub groups       † Poor prognosis is defined as having one or more of the following high risk features: age &gt;60 years, unfavorable cytogenetics, FLT3 ITD positive or secondary AML            
The two-sample t test was used to compare mean ages of CR and NR patients. Fisher&#39;s Exact test was used to compare CR and NR patients with respect to categorical variables with two levels. The standard Chi-Square test was used to compare CR and NR patients with respect to categorical variables with three or more levels.
 
     DISCUSSION 
     The two studies reported here show that AML characterization using modulated SCNP can be performed with high technical accuracy and reproducibility to quantitatively characterize the biology of AML in individual patients. Furthermore, this characterization is predictive of disease outcome in response to specific therapeutic interventions and distinct from other known prognostic factors (such as age, secondary AML and cytogenetics). Basal protein expression profiling patterns as measured by RPPA in AML was recently shown to correlate with known morphologic features, cytogenetics and clinical outcomes (Kornblau et al. Blood. 2009; 113:154-164). While these studies show high sensitivity, throughput, and reproducibility for baseline measurements they cannot provide any evaluation of the dynamic response to stimuli of a specific cell population or of single cells in a heterogeneous cell population. Resistance or relapse is thought to arise from rare populations of blasts with different characteristics that enable them to survive induction therapy. We therefore hypothesize that the ability to measure the adaptability of individual cells (or subpopulations) to different modulation and assessing intra-patient clonal heterogeneity, will provide knowledge with greater informative content and relevance with respect to responsiveness and the crucial characteristics that give rise to disease persistence. 
     The data presented are from two independent, sequentially tested patient sample sets (total n=122) obtained from the leukemic cell banks of two centers, PMH/UHN and MDACC. The sets differ substantially in sample number, source of leukemic cells and patient clinical characteristics. The first, smaller study tested PBMCs, collected from predominately female patients &lt;60 years, whose disease did not respond to standard induction chemotherapy. The second training study included 88 evaluable BMMC AML samples obtained mostly from patients &lt;60 years old, with a more typical rate of responsiveness to cytarabine (plus additional drugs in most) based induction therapy. 
     The differences in source of leukemic blasts and induction therapy were hypothesized to be unimportant for the interpretation of the study results. It has previously been shown that protein levels in AML cells do not appear to exhibit biologically relevant differences between specimen sources (Kornblau et al. Blood. 2009; 113:154-164) and clinical outcome appears to be independent of cytarabine dose (100 mg/m 2 −3 g/m 2 ) (Sekeres et al. Blood. 2009; 113:28-36). Both patient cohorts lacked sufficient leukemia samples from older patients responsive to induction chemotherapy limiting the strength of the observations for this subset of patients. 
     Despite the above limitations, many important observations could be made: First the SCNP assay demonstrates the level of robustness and reproducibility needed for clinical application. The first study began with a large panel of nodes selected for their role in myeloid biology. In particular, pathways known to be altered in multiple malignancies and involved in cell survival, proliferation and DNA damage were probed. Throughout normal myeloid differentiation these pathways are tightly regulated by a variety of cytokines and growth factors used in SCNP assays. For example, SCF and Flt3L are important for maintaining the hematopoietic stem cell pool (Lyman et al. Blood. 1998; 91:1101-1134; Kikushige et al. J Immunol. 2008; 180:7358-7367); G-CSF is important for neutrophilic differentiation of hematopoietic progenitor cells (Touw et al. Front Biosci. 2007; 12:800-815); IL-6 family members including IL-6 and IL-27 regulate proliferation, differentiation and functional maturation of cells belonging to multiple hematopoietic lineages (Seita et al. Blood. 2008; 111:1903-1912) and IL-10 modulates the immune response of monocytes and macrophages and was previously shown to play a role in AML blast proliferation (Bruserud et al. Cytokines Cell Mol Ther. 1998; 4:187-198). Consistent with this knowledge, the first training study univariate analysis identified 58/304 statistically significant node/metrics (i.e. AUC of the ROC&gt;0.66 with ap value &lt;0.05), predictive for clinical response to induction therapy. These included G-CSF induced Jak/Stat signaling, previously shown to be potentiated in AML (Irish et al. Cell. 2004; 118:217-228) and new observations of IL-27, IL-10 and IL-6 mediated signaling. Furthermore, transformed cells evade apoptosis by activating survival pathways or by disabling apoptotic DNA damage machinery or signaling. Therefore, Caspase-dependent apoptosis was also used to characterize patient responses after in vitro exposure of AML samples to etoposide and Ara-C/daunorubicin. Importantly both etoposide and Ara-C/daunorubicin activated apoptosis were shown to stratify patients by clinical outcome in both studies. 
     The external validity of these original observations was then tested in the second training study, which included a larger sample set that was more representative of the general U.S. AML population but more heterogeneous in terms of baseline disease characteristics. The analysis of the data from the two studies suggests that the difference in baseline characteristics of donors in the two studies played a significant role in the differences observed in the stratifying nodes between the two studies. However, similar trends existed for some of the stratifying nodes (such as p-Stat1 and p-Stat3 response to IL-27 and cleaved PARP to etoposide) were observed across the two studies when similar subsets of patients (although small) where compared. Another important observation that emerged from this second study was the ability of SCNP assays to reveal different pathways that correlated with patient outcome within patient subgroups defined by clinical prognostic characteristics such as age, cytogenetics and presence or absence of secondary leukemia. Specifically, in patients younger than 60 years of age, intact communication between DNA damage response and apoptosis after in vitro exposure to chemotherapeutic agents emerged as an important biologic characteristic that identified CR samples. By contrast, for patients over age 60 or with secondary AML lack of response to induction chemotherapy was associated with increased Flt3L induced p-Akt and p-Erk. Importantly, combining age with some predictive nodes (such as IL-27 mediated p-Stat1 or p-Stat3), increased the AUC of the ROCs from 0.65 for age alone to 0.87 and 0.89, respectively, with highly significant p values (not shown). This shows that SCNP assays can distinguish AML disease biology beyond age. 
     Finally, although univariate analysis of signaling nodes stratified patient samples based on leukemic response to induction therapy, the combination of independently predictive nodes improved predictive value significantly. 
     In summary, this study demonstrated, in two very diverse patient cohorts, the potential value of using leukemia signaling biology to stratify patient samples into those that likely will or will not respond to ara-c based induction chemotherapy. These results emphasize the value of comprehensive functional assessment of biologically relevant signaling pathways in AML blasts as a basis for the development of highly predictive tests for response to therapy. 
     Example 9 
     This example relates to publication “Functional Characterization of FLT3 Receptor Signaling Deregulation in AML by Single Cell Network Profiling (SCNP)”. Rosen D B, Minden M D, Kornblau S M, Cohen A, Gayko U, Putta S, Woronicz J, Evensen E, Fantl W J, Cesano A. PLoS ONE. 2010. October; In Press. This publication is incorporated herein by reference it its entirety for all purposes. 
     This example identifies intracellular signaling pathways associated with FLT3 ITD in two independent cohorts of diagnostic AML samples that serve as an improvement over current clinical tools in the identification of clinically meaningful altered FLT 3 and has implications for cohort selection in the development of FLT3 inhibitors. The two cohorts of data were further analyzed to investigate the differences in signaling between FLT-WT and FLT-ITD samples. The first cohort of data (“study 1”) comprised the 34 samples from University Health Network outlined in Table 16 and Table 19. The second cohort of data (“study 2”) comprised an 83 sample subset of MD Anderson Cancer Center data outlined in Table 16 (and Table 19). The 83 sample subset was selected based on known FLT3 mutation status. Both cohorts of data were used to investigate differences in FLT3 signaling between leukemic blasts and control data. 
     FLT3 WT Signaling in Healthy Control and AML Samples 
     In order to further characterize wild-type FLT receptor signaling in AML, we compared FLT3L-induced signaling in the myeloblast population of control BMMC samples with FLT3L-induced signaling in the leukemic blast population of FLT3-WT AML samples. FLT3L activated the MAPK and PI3K pathways, inducing increased levels of p-Akt and p-S6 in both BMMC and FLT3-WT AML samples at early time points (4 minutes, 10 minutes). However, kinetic differences between the two sets of samples were observed at later time points ( FIG. 12 ). In the BMMC samples, activation of p-Akt and p-S6 was largely diminished by 15 minutes, likely due to regulatory feedback mechanisms. In the FLT3-WT AML samples, sustained p-Erk, p-CREB and p-Akt activation was observed in a number of samples at 15 minutes ( FIG. 13 ). These results demonstrate that kinetic differences in signaling at different time points can be used to distinguish FLT3-WT AML samples from healthy BMMCs. 
     Variance in intensity of cell signaling may be used to distinguish FLT3-WT and healthy cells.  FIGS. 10, 11, 12 and 13  illustrate the ranges of signaling observed in FLT3-WT and BMMC samples.  FIG. 1  contains “box and whisker” plots of FLT3 levels and FLT3L-induced S6 signaling for both the FLT3-WT AML and BMMC samples. In BMMC samples, FLT3L induced a narrow range of S6 signaling. In FLT3-WT AML samples, FLT3L induced a wide range of S6 signaling. In agreement, standard deviations from measures of FLT3 signaling were higher in FLT3-WT AML than in healthy BMMb. In addition, the variance in FLT3 receptor signaling was statistically different (p-value=0.003, Levene&#39;s test) between the FLT3-WT AML and healthy BMMb samples ( FIG. 14 ) In the BMMC samples, the S6 signaling did not co-occur with increased Stat5 signaling (not shown) however in FLT3-WT AML p-Stat5 was induced by FLT3L in some samples. 
       FIG. 10  also contains scatter-plots that compare FLT3L-induced S6 signaling with FLT3 receptor levels. From the scatter-plots, it is shown that the FLT3L-induced S6 signaling is independent of FLT3 receptor levels in both cohorts (i.e. there is no linear correlation between FLT3 expression and S6 signaling), although there may be a threshold level of FLT3 receptor required for S6 signaling. 
     Although individual samples displayed uniform FLT3 receptor staining, induction of p-S6 was only observed in a fraction of cells, suggesting the presence of distinct FLT3L responsive and non-responsive subpopulations in healthy and AML samples.  FIG. 11  illustrates FLT3L responsive and FLT3L non-responsive subpopulations in BMMC samples. Accordingly, FLT3L-induced p-S6 signaling may be used in gating or other types of analyses in order to select a cell subpopulation with a distinct disease/response phenotype. 
     Signaling Differences and Classification of FLT3-WT and FLT3-ITD 
     Univariate analysis, unadjusted for multiple testing, was performed sequentially and independently on the two study cohorts in order to identify signaling nodes that distinguished with FLT3-ITD from FLT3-WT AML patient samples. In study 1, 75 of the 304 node/metrics tested distinguished FLT3-ITD from FLT3-WT AML patient samples with an AUC of ROC&gt;0.7 and p&lt;0.05. Results from study 1 are tabulated in  FIG. 22 . In study 2, 35 of the 201 node/metrics distinguished FLT3-ITD from FLT3-WT AML patient samples with an AUC of ROC&gt;0.7 and p&lt;0.05. Results from study 2 are tabulated in  FIG. 26 . Results from both studies include the AUC, Wilcoxon and t-test p-value for each node, and the number/mean value of the samples in the FLT3-ITD and FLT3-WT AML groups with common stratifying nodes summarized in  FIG. 23 . Although the majority of the discussion herein is directed to nodes that had similar reponses within the two cohorts of data, some differences were observed between the two cohorts of data. These differences may have been due to the different clinical characteristics of the two cohorts of data, specifically biases in the data from UHN. 
     Analysis of the false discovery rate for both studies showed this frequency to be significantly greater than the number of signaling nodes that would be expected to be significantly different between the two groups by chance (t-test p-value=0.0009). Stratifying nodes that distinguished FLT3-ITD from FLT3-WT samples in both studies represented distinct biological networks including Jak/Stat, PI3K and apoptosis pathway readouts ( FIG. 22 ,  FIG. 26 ). 
     FLT3 Signaling and Receptor Levels in FLT3-WT and FLT3-ITD Samples 
     Both FLT3-ITD and FLT3-WT samples expressed similar ranges of FLT3 receptor levels. Basal levels of p-Erk, p-Akt, and p-S6 did not differ significantly between FLT3-ITD and FLT3-WT samples. However, we observed distinct FLT3L-induced signaling responses in the two sets of samples. With FLT3L induction, FLT3-ITD samples showed lower levels of induced and total PI3K and MAPK pathway activation compared to FLT3-WT samples. 
     Differences in the PI3K pathway activation were evidenced by FLT3L induction of p-S6 which, in univariate analysis, provided discrimination between FLT3-WT and FLT3-ITD samples in study 1 and study 2 with p-values of 0.038 and 0.036, respectively (Wilcoxon p-values).  FIG. 15  contains “bar and whisker” plots that demonstrate the range of values of both FLT3 receptor levels and FLT3L-induced S6 signaling. These plots illustrate that FLT3-ITD exhibits a much narrower range and lower values of S6 signaling as compared to FLT3-WT. 
     Distinct Jak/Stat Signaling in FLT3-WT and FLT3-ITD Samples 
     Variance in response to a stimulator may also be used to distinguish samples based on their mutational status. IL-27 induced a wide range of p-Stat responses in the FLT3-WT samples. FLT3-ITD samples displayed minimal responsiveness to IL-27 stimulation. 
       FIG. 16 (panel b) illustrates the differences in IL-27-induced Jak/Stat pathway response between FLT3-WT and FLT3-ITD. IL-27-induced Stat signaling activity was reduced in FLT3-ITD samples with significantly lower induction of p-Stat3 (t-test p-value &lt;0.029) and p-Stat5 (t-test p-value &lt;0.038) in both studies. The fold induction of p-Stat responsive to IL-27 (IL-27→p-Stat 3|Fold) signaling node in univariate analysis distinguished FLT3-WT and FLT3-ITD in both samples (AUC 0.69 in study 1 and AUC 0.73 in study 2, respectively). Notably, FLT3-ITD samples displayed higher basal levels of p-Stat5 and p-Stat1 compared with FLT3-WT samples in Study 1. 
     Distinct Apoptotic Responses in FLT3-WT and FLT3-ITD Samples 
     Etoposide-induced DNA damage and apoptosis was measured to identify FLT3-mutation-based differences in DNA Damage response (DDR) and apoptotic machinery. Increased p-Chk2 and cleaved PARP were used to measure the ability of etoposide to induce DNA damage and apoptosis, respectively.  FIG. 16 (panel c) illustrates the differences in etoposide-induced DNA damage between FLT3-WT and FLT3-ITD samples. As measured using total cleaved PARP induced by etoposide (etoposide→c-PARP|Total), FLT3-ITD samples were more sensitive to in vitro apoptosis than FLT3-WT samples (AUC 0.82 in study 1 and AUC 0.73 in study 2). Similar results were observed in both study 1 and in study 2 using other mechanistically-distinct apoptosis-inducing agents such as staurosporine, a pan kinase inhibitor, and in study 2, Ara-C/Daunorubicin. Accordingly, a wide range of apoptosis-inducing agents may be used to induce signaling that stratifies FLT3-ITD from FLT3-WT samples. 
     Stratifying nodes that distinguished FLT3-ITD from FLT3-WT samples in both studies represented distinct biological networks including Jak/Stat, PI3K and apoptosis pathway readouts and are summarized graphically in  FIG. 17 . 
     FLT3L and IL-27 Induced Signaling in FLT3-ITD, NPM1 Molecular Subgroups 
     IL-27 induced Jak/Stat signaling and FLT3L induced PI3K and Raf/Ras/MAPK signaling responses was assessed in FLT3 receptor and NPM1 molecular defined subgroups. For all nodes analyzed, the FLT3-WT/NPM-WT subgroup demonstrated the most variable signaling responses and often contained samples with the most elevated signaling ( FIG. 24, 25 ). In contrast, within FLT3-ITD/NPM1 mutated patients, IL-27-induced and FLT3L-induced signaling appeared more uniform and generally lower compared to FLT3-WT/NPM-WT samples. FLT3-WT/NPM1-WT samples demonstrated the highest variance among FLT3 NPM1 subgroups for IL-27 and FLT3L signaling and demonstrated significantly higher variance compared to both FLT3-ITD subgroups ( FIG. 14 ). Of note, the largest differences in variance were observed between FLT3-WT/NPM-WT and FLT3-ITD/NPM-Mutated samples ( FIG. 14 ). 
     Correlations Between Nodes 
     Several of the top-ranking nodes stratifying FLT3-ITD from FLT3-WT samples were analyzed to identify co-variance in FLT3-mutation-dependent signaling.  FIG. 18  and  FIG. 21  illustrate the correlations between the top ranking nodes. Pearson correlation coefficients were computed for all signaling nodes from study 1 with a t-test p-value ≦0.05 demonstrated correlation between nodes belonging to the same pathway. For example, nodes within the Stat pathway (IL-27→p-Stat3|Fold and IL-27→p-Stat5|Fold) exhibited a correlation of R=0.81. The same signaling protein was observed to have similar reactions to different modulators with a correlation of R=0.87 (Thapsigargin→p-CREB|Fold and PMA→p-CREB). Nodes measuring signaling events in different pathways were less correlated (e.g. Thapsigargin→p-CREB|Fold and IL-27→p-Stat5|Fold (R=0.04). 
     The identification of high correlation values between similar nodes affirms the quality of results and allows us to identify FLT3-mutation-stratifying nodes that can be used interchangeably in a classifier such as a bivariate model or a multivariate model. Conversely, identification of FLT3-mutation-stratifying nodes with a poor correlation value allows us to identify pairs of nodes that may complement each other for increased classification accuracy. 
     Association Between Multiple Signaling Nodes and FLT3 ITD Status—Multivariate Analysis Using Linear Regression 
       FIG. 19  provides a schematic overview of bivariate modeling. Bivariate modeling combines different signaling nodes to generate a model that provides better stratification of FLT3-ITD and FLT3-WT AML samples than the individual nodes. We evaluated all possible pairs of the 75 signaling nodes with AUC of the ROC&gt;0.7 and p-value&lt;0.05 (tabulated in  FIG. 22 ) for their ability to improve stratification of the FLT3 mutational status. This modeling exercise was performed to identify potential combinations within or across pathways that might form the basis of future studies. All combinations of nodes that had an AUC greater than the best single node/metric within the combination were tabulated in  FIG. 27 . The AUC for the tabulated models ranged from 0.89 to 0.98. As discussed above, the probability of two nodes to complement one another was higher if the nodes participated in different signal transduction pathways: e.g. combining the nodes IL-6→p-Stat5|Total (AUC=0.84) and FLT3L→p-S6|Total (AUC=0.80) yields an improved AUC of 0.98. 
     Clinical Implications 
     To better understand the clinical implications of the FLT3-mutation-stratifying nodes, we independently examined the FLT3-mutation-stratifying signaling profiles in samples from two groups of Cytogenetically Normal (CN) AML patients. Each group of patients represented clinically extreme “outliers” based on their mutation status: 1) FLT3-WT AML who experienced disease relapse within 3 months after initial remission (i.e. rapid relapse) and 2) FLT3-ITD AML in complete continuous disease remission for two or more years. In study 2 there were 2 FLT3-WT and 2 FLT3-ITD samples associated with these clinical characteristics. 
     The wide range of signaling responses observed in FLT3-WT AML samples made identification of signaling outliers challenging.  FIG. 20 (panel A) provides a scatter-plot of the signaling profiles in the two rapid relapse FLT3-WT samples (MD3-19 and MD3-37) showing attenuated p-S6 and p-Erk in response to FLT3L, similar to the FLT3L-induced signaling observed in FLT3-ITD samples (see  FIG. 15 ,  FIG. 16 (panel a) for FLT3-ITD FLT3L-induced signaling).  FIG. 20 (panels B and C) provide scatter-plots showing minimal IL-27-induced Stat phosphorylation in MD3-19, similar to FLT3-ITD samples (see  FIG. 16 (panel b) for FLT3-ITD IL-27-induced Stat signaling), suggesting that these rapid relapse FLT3-WT samples might share similar biology with FLT3-ITD samples in certain pathways. 
     Identification of FLT3-ITD signaling outliers was aided by the narrow range of signaling responses of this sample set. In the CN FLT3-ITD sample group, two patients remained in complete continuous remission for two or more years. One patient (MD2-22) had been treated with chemotherapy alone and the other (MD3-22) was treated with an allogeneic stem cell transplant (as per NCCN guidelines). Since MD3-22 received high intensity post-remission therapy we focused on signaling associated with sample MD2-22. 
     MD2-22 obtained from a patient who received high dose Ara-C similar to what is recommended for “low risk” cytogenetic leukemia. We found that the FLT3-ITD MD2-22 sample signaling profile was closer to FLT3-WT as illustrated by the first two principal components of PCA Analysis (not shown). This observation was further reinforced by the number of nodes (16) for which MD2-22 was an outlier among the FLT3-ITD group (i.e. outside of 1.5 times the inter-quartile from the median for FLT3-ITD). These nodes included those from the Jak/Stat pathway (e.g., IFNα→p-Stat1, p-Stat3, p-Stat5; G-CSF→p-Stat3, p-Stat5), the CREB pathway (e.g. PMA→p-CREB); and the PI3K and MAPK pathways (e.g., FLT3L→p-S6, p-Akt; SCF→p-S6, p-Akt). A following molecular analysis of this sample indicated the presence of an NPM1 gene mutation although this information was not available at the time of post-remission treatment. 
     An analysis within FLT3-WT AML samples, demonstrated that higher measures of induced apoptosis (i.e. Ara-C/Dauno→C-PARP I Fold) were associated with CR duration greater than two years (AUCROC: 0.92) These data show the ability of SCNP to provide information, independent from molecular determinations relevant to the clinical decision making of AML. 
     DISCUSSION 
     These data suggest that assessing patient samples for the presence of FLT3 receptor deregulation may inform clinical decision making regarding standard treatment as well as serving as a tool for patient stratification in studies attempting to evaluate specific inhibitors of the FLT3 receptor. This functional assessment of biologically relevant signaling pathways in AML blasts shows the spectrum of deregulated signal transduction not previously described in primary AML samples. 
     The current investigation represents the first analysis comparing pathway activity and inducibility in the absence or presence of modulators known to activate Jak/Stat, PI3-kinase/Akt/S6 and the Ras/Raf/Erk/S6, phosphatase/reactive oxygen species, and DDR/apoptosis pathways in FLT3-WT and FLT3-ITD AML samples. We found that FLT3L induced differential signaling in FLT3-WT AML independently of the presence of FLT3 mutations as compared to the healthy BMMC. These data show that SCNP uncovers important heterogeneity in AML and has potential as a platform for understanding leukemia pathway dependence in the individual patient, information that will be valuable for the selection of therapeutic strategies in the era of personalized medicine. 
     Although FLT3 receptor levels were similar between the FTL3-WT and FLT3-ITD AML groups in this study, FLT3-ITD samples displayed attenuated responses to FLT3L, as measured by induced levels of p-Erk, p-Akt and p-CREB versus their FLT3-WT counterparts While increased levels of basal p-Erk and p-Akt have been reported in FLT3-ITD expressing cell lines, our data demonstrated comparable levels of basal p-Erk and p-Akt among FLT3-ITD and FLT3-WT primary AML samples. These data suggest the greater dependence of FLT3L inducibility of these signaling networks in FLT3-WT AML and demonstrate FLT3L-independence in FLT3-ITD samples. 
     Consistent with these studies FLT3-ITD samples expressed increased basal levels of p-Stat1, p-Stat3 and p-Stat5 compared to FLT3-WT samples in Study 1 and in both studies FLT3-ITD AML samples displayed a uniformly limited range in basal p-Stat5 levels compared to FLT3-WT samples. Additionally, in contrast to signaling in healthy myeloid blasts, FLT3L induced p-Stat5 in some FLT3-WT samples, demonstrating deregulated FLT3 receptor signaling even in the absence of FLT3 mutational alterations. 
     Different signaling responses were also observed between FLT3-WT and FLT3-ITD samples for IL-27 induced Jak/Stat pathway activity. Most studies characterizing the biology of IL-27 have been performed on lymphocytes where this cytokine plays a major role in immune regulation. However, the IL-27 receptor is present on other cell types, including those of the myeloid lineage, where its activation has been shown to enhance proliferation and differentiation of mouse and human hematopoietic stem/progenitor cells. In Study 1, increased levels of basal p-Stat1 and p-Stat5 were observed for FLT3-ITD compared to FLT3-WT samples. Our data suggest these FLT3-ITD samples are less responsive to IL-27 mediated Stat signaling, likely because they already display elevated Stat pathway activity. This growth factor independence could contribute to the poor clinical outcome observed within FLT3-ITD patients. 
     Analysis of the apoptosis pathways showed that FLT3-ITD samples were more sensitive to in vitro etoposide and other apoptosis inducing agents than FLT3-WT samples. While these results using cryopreserved diagnostic samples may seem somewhat counterintuitive to the clinical findings that FLT3-ITD patients have a worse overall survival and shorter duration of remission, to date the presence of FLT3-ITD has not been associated with response to induction therapy. 
     The clinical implications of our observations suggest that SCNP analysis could be applied to clinical decision-making as well as to evaluating responsiveness to inhibitors of FLT3 receptor signaling and/or other activated pathways. Despite the limited sample size and the exploratory nature of the analyses some interesting observations emerged. Specifically, we identified FLT3-WT AML samples whose SCNP responses resembled those of FLT3-ITD AML and furthermore behaved clinically like high risk AML. Conversely, we found a case of FLT3-ITD AML that functionally resembled FLT3-WT, and behaved clinically like low-risk AML. These data suggest SCNP has the potential to provide improved prognostic information beyond FLT3 molecular characterization alone. Lastly, multiple therapeutics that target FLT3 receptor (e.g., CEP701, PKC412, AB220) are in development for the treatment of AML. To date, the characterization of AML based on the mutational status of the FLT3 gene has shown not to be very informative in predicting the activity of any of these FLT3 receptor inhibitors and their effects on signaling transduction remains unknown. In this regard, SCNP could be used as a tool to identify AML patients who could benefit from administration of such inhibitors alone or in combinations with other standard agents and/or targeted inhibitors. Further studies in the context of clinical trials are warranted. 
     Example 10 
     This example relates to publication “Distinct Patterns of DNA Damage Response and Apoptosis Correlate with Jak/Stat and PI3Kinase Response Profiles in Human Acute Myelogenous Leukemia”. Rosen D B, Putta S, Covey T, Huang Y W, Nolan, G P, Cesano, A, Minden M D, Fantl W J. PLoS ONE. 2010 August; 5(8): e12405. This publication is incorporated herein by reference in its entirety for all purposes. 
     This example further characterizes the data outlined above with regards to Example 6 based on the activities of their intracellular signaling pathways. Analysis of Jak/Stat, PI3K, DNA damage response (DDR) and apoptosis pathway activities demonstrated biologically distinct patient-specific profiles, even within cytogenetically and cell surface uniform patient sub-groups. Thus, while AML is known to be clinically heterogeneous, the biology described in this study shows that the heterogeneity in the disease may be represented by a limited number of intracellular signaling pathways highlighting survival pathways, DDR and their link to apoptosis. 
     Principle Component Analysis (PCA) was used in addition to our standard metrics for measuring activation levels. PCA is a dimension reduction technique commonly used to represent multi-dimensional data according to the strongest “trends” or associations in the data. Here, we used PCA to represent several nodes in the same pathway according to a trend or direction in the data. PCA was performed for Jak/Stat and PI3K nodes using both “Fold and “Total” metrics of induced pathway activity along with the corresponding basal nodes. 
     The application of PCA to multi-dimensional data representing the same pathway is beneficial for several reasons. As discussed above with respect to Example 10, nodes that are part of the same pathway can have a similar response and exhibit covariance over different samples or even cells Accordingly, combining the data into one metric may adequately represent the entire pathway. Also, since PCA identifies the strongest trend in the data, the use of PCA allows for the representation of small variations in a signaling pathway in a single metric. Accordingly, PCA-based metrics may provide the ability to distinguish small variations in signaling pathways associated with disease. 
     Univariate analysis was also used to identify nodes/metrics that stratified patients based on their disease response to standard induction therapy. Each node/metric combination was evaluated using univariate analyses. Jak/Stat and PI3K nodes that stratified clinical CR and NR patients (Area Under the Curve of the Receiver Operator Characteristic (AUCROC)&gt;0.6 and p-value &lt;0.05) were used for principle component analyses and for selecting examples of the node/metrics that were used to construct the heat-maps. 
     Results 
     As described above with regards to Example 6, SCNP analysis of the Jak/Stat and PI3K signaling pathways was carried out in AML blasts after their exposure to a panel of modulators. 
     Jak/Stat Pathway Activity 
     To assess the activity and inducibility of the Jak/Stat pathway, samples were treated with G-CSF, IL-6, IL-27, IL-10, IFNα and IFNγ, known to activate the Jak/Stat pathway. AML samples were characterized by the magnitude of their basal Jak/Stat pathway activity as well as by the induced responses (Fold metric) and total level of Jak/Stat pathway activation (Total metric). The latter two metrics used paralleled each other. Low or absent levels of induced phosphorylation of Stat 1, Stat 3 and Stat 5 proteins were associated with gated AML blasts from CR patients exemplified by the 2D flow plots observed for responses of sample UHN_0713 to G-CSF and IL-27 (not shown). In contrast, potentiated Jak/Stat signaling was observed as well as increased pathway activity in cells taken from patients whose leukemia was non-responsive to induction chemotherapy, as observed in a 2D flow plot for myeloid-gated cells for sample UHN_9172 (not shown). In most NR patient samples Jak/Stat signaling was elevated in a cell subpopulation in response to multiple cytokines, whereas cells of most CR patients were largely non-responsive. IL-27 and IL-6-mediated-phosphorylation of Stat3 were closely correlated, as would be expected for two cytokines sharing the gp130 common signal transduction receptor subunit. 
     PI3K Pathway Activity 
     A second major survival pathway interrogated in this study was PI3K, known to play a role in most cancers. Converging signals from the PI3K/mTor and Ras/Erk pathways result in phosphorylation of ribosomal protein S6 which correlates with increased protein translation of mRNA transcripts that encode proliferation and survival promoting proteins. 
     Analogously to activation of the Jak/Stat pathway, application of known activators of the PI3K pathway including FLT3L, SCF and SDF-1a broadly grouped AML samples by the magnitude of their signal transduction responses (Fold metric) and overall pathway activity (Total metric) represented by measurements of p-Akt and p-S6. In the same manner that low levels of modulated Jak/Stat responses and Jak/Stat pathway activity were seen in leukemic cells from CR patients, samples in which p-Akt/p-S6 signaling was low or absent were also associated with clinical responsiveness to chemotherapy. Additionally, in the same manner that high levels of induced Jak/Stat responses and high levels of Jak/Stat pathway activity were seen in leukemic cells from NR patients, elevated PI3K pathway responses were also associated with clinical non-response to chemotherapy as observed by a 2D flow plot for sample UHN_4353 (not shown). Importantly, no associations could be made between cytogenetic risk category and the French American British category (FAB) within these signaling responses. 
     Correlated Measures of Induced JAK/STAT and PI3K Signaling Reveals AML Blasts with Distinct Pathway Responses 
     In order to evaluate the effect of modulation on both the Jak/Stat and PI3K pathway activities, PCA was performed for each pathway in its basal state as well as its functionally activated state. The PCA analysis for the activated states of the pathways combined readouts from multiple modulators known to activate the Jak/Stat and PI3K pathways. Induced pathway activity, rather than basal pathway activity, could more readily reveal distinct patient-specific functional response patterns.  FIGS. 28( a )  and ( b ) demonstrate the stratification that PCA achieves when applied to induced nodes in pathways is significantly better than for basal nodes. This is to be expected because since PCA identifies the strongest trend in the data. If the pathways don&#39;t have a multiplicity of different states due to induction, PCA will not be helpful in segregating the different states. 
       FIG. 28( b )  illustrates the multiple response profiles observed in the modulated AML samples. In the modulated samples, activity was high or low for both pathways or high for one and low for the other pathway. Interestingly, although the number of samples from CR patients (shown in  FIG. 28( b )  as filled blue circles) is low (n=9), a low signaling capacity in both Jak/Stat and PI3K/S6 pathways was associated with clinical response to chemotherapy. In contrast, augmented signaling responses from one or both the Jak/Stat and PI3K pathways were observed in most samples from chemotherapy refractory patients (i.e. NR patients, shown in  FIG. 28( b )  as unfilled red squares). A sub-group of the NR AML blast samples low level signaling responses in both Jak/Stat and PI3K pathways (lower-left-hand quadrant) were observed, suggesting that other pathways could be contributing to clinical refractoriness to chemotherapy. These data suggest that activation of the PI3K and Jak/Stat pathways might oppose response to chemotherapy. Further, the stratification between different AML samples achieved using PCA demonstrates that principle component of pathway activity is a useful metric for characterizing heterogeneity in AML samples and stratifying different subtypes of AML cells. 
     Measurements of DDR and Apoptosis with In Vitro Exposure to Etoposide and Staurosporine 
     As described above with regards to Example 6(α), DDR and apoptosis was measured using Chk2 and cleaved PARP after exposure of AML blasts to etoposide, a topoisomerase II inhibitor that induces double stranded breaks.  FIG. 29  illustrates the three distinct responses that were observed: (1) AML blasts with a defective DDR and failure to undergo apoptosis (2) AML blasts with proficient DDR and failure to undergo apoptosis (3) AML blasts with proficient DDR and apoptosis. All CR samples were exemplified by the third profile whereas NR samples were exemplified by all three response profiles 
     Staurosporine induced apoptosis responses were evaluable in 26/33 of the AML samples.  FIG. 30 (panel a) is a scatter plot comparing etoposide versus staurosporine-mediated apoptosis.  FIG. 30 (panel a) shows percentage of cells within an AML sample undergoing apoptosis and for no sample was this value 100% at the time points chosen in this study. All samples with blast subsets refractory to in vitro etoposide exposure, regardless of their staurosporine response, were derived from the NR patient sample subgroup. Apoptosis responses identified all CR patients as apoptosis competent to both agents. However, a negative apoptotic response could not predict all NR patients, underscoring the fact that in vitro responses alone to apoptosis stimulating agents are only part of the equation that describes a clinical outcome. 
       FIG. 30 (panel b) shows examples of different response profiles for different AML samples (both NR and CR) in response to Etoposide or Staurosporine. Notably some samples were sensitive to staurosporine yet refractory to etoposide (UHN_0401). This implies that the apoptotic machinery per se was intact in these cells and that the resultant refractory response to etoposide could be the result of ineffective communication between the machinery of the DDR with that of apoptosis (exemplified by sample UHN_0401). Other categories of response shown are relative refractoriness to both agents (exemplified by sample UHN_8190) or responsiveness to both agents (exemplified by sample UHN_8303). Treatment with distinct apoptosis inducing agents revealed distinct percentages of apoptotic (c-PARP+) and non-apoptotic (c-PARP-) subpopulations of cells within an individual AML sample. This indicates that within an AML sample there are blast cell subsets with different sensitivities to each agent. 
     Associations Between In Vitro Apoptosis Profiles and Jak/Stat and PI3K Pathway Activity 
     The Jak/Stat and PI3K pathway activities observed in leukemic samples were further analyzed in the context of the in vitro apoptotic responses illustrated in  FIG. 30 (panel a).  FIG. 31 (panel A) illustrates the selection of staurosporine refractory and responsive cells.  FIG. 31 (panel B) contains scatter plots which illustrate IL-27-induced and G-CSF-induced Stat signaling responses in the staurosporine outliers.  FIG. 31 (panel C) contains scatter plots that compare a principle component representing Stat pathway activity (derived from PCA of the nodes associated Stat pathway).  FIG. 31 (panel D) tabulates the Pearson and Spearman correlations between staurosporine response and individual nodes. 
     As shown in  FIG. 31 (panel B), Jak/Stat signaling responses were of variable magnitude for samples with relatively low or high responsiveness to etoposide as well as samples that were sensitive to staurosporine (UHN_5643, UHN_0521, UHN_5684 and (C)). In the four samples with the lowest relative response (relative refractoriness) (UHN_4353, UHN_9172, UHN_8314) to staurosporine, Jak/Stat pathway responses were augmented. 
     The Pearson and Spearman coefficients tabulated in  FIG. 31 (panel D) demonstrated a statistically significant negative correlation between staurosporine induced apoptosis and Jak/Stat signaling in this AML sample set, with outliers clearly apparent. Statistical significance was found for the Jak/Stat PCA value with even greater statistical significance observed for individual nodes such as IL-6 or IL-27 induced Stat signaling. Pearson and Spearman coefficients revealed a lack of correlation for Jak/Stat signaling with etoposide response. 
     The PI3K pathway activities observed in leukemic samples were further analyzed in the context of the in vitro apoptotic responses illustrated in  FIG. 30 (panel a).  FIG. 32 (panel a) illustrates the selection of etoposide and staurosporine refractory and responsive cells.  FIG. 32 (panel b) contains scatter-plots which illustrate FLT3-induced and SCF-induced PI3K signaling response samples with high or low apoptosis responses to etoposide and staurosporine.  FIG. 32 (panel c) contains scatter-plots that compare a principle component representing PI3K pathway activity (derived from PCA of the nodes associated PI3K pathway).  FIG. 32 (panel d) tabulates the Pearson and Spearman correlations between staurosporine/etoposide response and individual nodes in the PI3K pathway. 
     As shown in  FIG. 32 (panel b), we observed an inverse correlation between levels of growth factor (SCF and FLT3L) and chemokine (SDF-1α)-mediated-p-Akt and p-S6 signaling and in vitro apoptotic response as characterized through etoposide and staurosporine. The Pearson and Spearman correlation coefficients tabulated in  FIG. 32 (panel d) demonstrate that this relationship is statistically significant.  FIG. 32 (panel d) demonstrates that the PCA metric for induced PI3K pathway activity has better negative correlation with staurosporine and etoposide response than individual node/metrics. These results confirm that PCA is a valuable tool for capturing signaling heterogeneity that may correlate to, or predict, clinical response. 
     The scatter-plots in  FIG. 32 (panel b) demonstrate that induced PI3K pathway signaling tended to be lower for samples that were apoptosis proficient to both etoposide and staurosporine (UHN_5684, UHN_8825 and UHN_8451). As shown in  FIG. 32 (panel b), greater induced p-Akt and p-S6 levels were observed in samples refractory to staurosporine and/or etoposide (UHN_0341, UHN_5643 and UHN_4353). 
     When taken together, trends for apoptosis, Jak/Stat and PI3K pathway activities ( FIGS. 30, 31 , and  32 ) and clinical outcomes suggest that there are limited number of signaling pathway profiles associated with CR patients (i.e. CR patients are homogeneous in signaling), whereas in NR patients many different pathway mechanisms may have evolved for the leukemia to be refractory to chemotherapy (i.e. NR patients are heterogeneous in signaling). All samples from CR patients had blast cell subsets that were sensitive to in vitro staurosporine and etoposide-mediated apoptosis and in general had low Jak/Stat and PI3K pathway responses. Most clinical NR samples that were competent to undergo in vitro apoptosis had an absent or low PI3K response, suggesting that other pathways could be contributing to refraction to therapies that induce apoptosis. All other NR samples were refractory to in vitro etoposide and/or staurosporine exposure with different degrees of elevated Jak/Stat and/or PI3K pathway activation. Since PCA metrics of pathway activation had a clear correlation with apoptotic response, which in turn was predictive of therapeutic response (CR/NR), it can be inferred that PCA metrics of pathway activation provide another valuable metric that can be used to stratify patients as to their clinical response type, but also to further stratify and biologically characterize NR patients according to heterogeneity underlying the disease. 
     Associations Between In Vitro Apoptosis Profiles and Cell Subpopulations 
     Analysis of CD33 and CD45 surface expression of all samples within this AML cohort defined three patient samples with two distinguishable leukemic cell subpopulations, referred to as Blast 1 and Blast 2. In all cases, Blast 1 was defined as a cell subset with higher CD33 and CD45 levels, whereas Blast 2 cells had lower levels of these surface proteins. Given the distinct signaling profiles identified for cell subsets within samples harboring only one myeloid blast population as defined by CD33 and CD45 expression, in the preceding data of this study, it seemed likely that samples harboring two myeloid blast populations could harbor distinct signaling profiles. 
     SCNP revealed distinguishable signaling responses within individual cells in each blast population measured simultaneously.  FIGS. 33 ( a )  and  33  ( b ) include the data from two of the three samples with available data for signaling and apoptosis nodes, both from NR patients.  FIG. 33  (panel A) demonstrates that blast populations 1 and 2 from sample UHN_0577 were refractory to etoposide-mediated apoptosis although both populations exhibited DDR, albeit to different magnitudes as seen by the frequencies of blasts with increased phosphorylation of p-Chk2. Exposure of the samples to staurosporine revealed that the apoptotic machinery was intact in both blast populations suggesting that etoposide refractoriness was the result of disabled communication between DDR and the apoptotic machinery. Comparison of each blast subset for its response to G-CSF revealed minimal increases in p-Stat3 and p-Stat5. However, inspection of the PI3K path-way revealed that Blast 1, but not Blast 2 had two discernible blast cell subsets with different levels of p-Akt and p-S6 in the basal state. Blast 2 had only one “low” level p-Akt and p-S6 blast cell subset. Furthermore, in Blast 1, FLT3L was able to induce both p-Akt and p-S6 signaling in the “low level” basal population. In contrast, for Blast 2 the predominant response to FLT3L was an increase in p-S6 alone. Using the metric of “total” as a measure of overall pathway activity, there was greater overall pathway activity for Blast 1 than for Blast 2 in both the basal and FLT3L-potentiated states reflecting significant contributions of both basal and evoked signaling responses. 
     As shown in  FIG. 33 (panel B), the two blast populations in sample UHN_8093 were both refractory to etoposide possibly through different mechanisms since there was a greater p-Chk2 response in Blast 1 and a reduced DDR in Blast 2. Blast 1 was very responsive to staurosporine which indicated that the apoptotic machinery is intact and that the etoposide refractoriness in Blast 1 could be accounted for by failure of DDR to communicate with the apoptotic machinery. In contrast, Blast 2 was refractory to staurosporine-mediated apoptosis. Notably, in Blast 2 G-CSF mediated greater increases in phosphorylated Stat3 and Stat5 compared to the increases seen in Blast 1. This was reflected by both the “fold” and “total” metrics. Inspection of PI3K pathway activity revealed that only a small blast cell subset responded to FLT3L treatment with the majority of cells remaining unresponsive. These data suggest that the higher activity seen for the Jak/Stat pathway for Blast 2 may account for its refractoriness to in vitro apoptosis and non-response in the clinic consistent with the data in  FIG. 31 . 
     DISCUSSION 
     The current study was designed to determine whether heterogeneity in individual AML samples can be characterized based on in vitro functional performance tests using SCNP to measure survival pathways, DDR and in vitro apoptosis. The major findings were that: (i) an individual sample can be comprised of leukemic blast subsets with distinct Jak/Stat, PI3K, DDR and apoptosis pathway responses, (ii) exposure of samples to modulators allowed these pathway responses to be revealed, (iii) PI3K pathway activity was high in most samples that were refractory to apoptosis-inducing agents in vitro, (iv) Jak/Stat pathway activity was high in samples refractory to staurosporine but only in some samples refractory to etoposide, (v) in vitro DDR and apoptosis profiles were variable in leukemic blasts between different samples and also within the same sample and (vi) SCNP of the pathways chosen reveal a restricted number of profiles for AML blasts from CR patients and multiple profiles for AML blasts from NR patients. 
     Thus, responders to chemotherapy demonstrated little variation in the signaling potential of the pathways evaluated (that is, cells remained relatively unperturbed by environmental stimuli applied). As such, in the CR samples both the potentiated responses to myeloid activators of the Jak/Stat and PI3K pathways, as well as “basal” pathway activity tended to be low whereas DDR with subsequent apoptosis was robust after in vitro etoposide exposure. By contrast, robust Jak/Stat and PI3K responses were revealed in most NR samples. These data are consistent with, and expand upon previous findings linking functional alterations in Jak/Stat signal transduction with poor response to chemotherapy in AML patients. In addition, all samples with impaired DDR or proficient DDR without subsequent apoptosis were NRs. A subset of NR samples were competent to undergo in vitro apoptosis and had low PI3K and Jak/Stat pathway responses suggesting that in these samples alternative pathways could be contributing to clinical refractoriness to chemotherapy. 
     This study used 34 diagnostic PBMC samples taken from patients for which clinical out-comes were blinded. However, the sample set was unintentionally biased with samples predominantly from NR, female patients of younger age with intermediate cytogenetics. In spite of these limitations, univariate analysis of this sample set and an independent sample set from a separate institution revealed common nodes for CR and NR stratification suggesting that survival, DDR and apoptosis pathways may be relevant ways to characterize AML disease subtypes. 
     The data suggest that while DDR, Jak/Stat, and PI3K pathways might serve as useful indicators of the biological underpinnings of therapeutic responses, additional inquiry or pathways might be required to more fully complete the characterization of response. The proliferative and survival properties of the Jak/Stat and PI3K pathways most likely play a central role in AML leukemogenesis as well as in refractoriness and resistance to clinically used DNA damaging agents. For instance, Stat transcription factors are known to play a critical role in normal and leukemic hematopoiesis targeting transcription of genes involved in prolife-ration, survival and differentiation. Receptors that signal through Stat3 and Stat5 are present on AML blasts where they can be activated by a wide variety of growth factors, interleukins and cytokines. Furthermore, in a recent study, the level of Stat5 transcriptional activity was shown to regulate the balance between proliferation and differentiation in hematopoietic stem cells/progenitor cells by activating specific genes associated with these processes. The same group showed that high levels of Stat5 activity disrupted myelopoiesis. In the current study, CR samples showed low or absent Jak/Stat responses and a subset of NR samples showed high magnitudes of Jak/Stat responses while the remaining NRs displayed a continuum of responses. These data suggest that certain levels of Stat activity may be necessary to generate the appropriate transcriptional program necessary for maintaining a particular clonal state of an AML blast cell subset. 
     In addition, deregulation of the PI3K/mTor signaling pathway has been described in 50-80% of AML cases contributing to the survival and proliferation of AML blast cells. Many causes for pathway deregulation have been cited such as activating mutations in FLT3 and Kit receptors, overexpression of the PI3K class 1A p1106 isoform as well as gain of function mutations in N- and K-Ras. In this study, PI3K pathway activity was determined by measuring levels of p-Akt and p-S6 ribosomal protein as pathway readouts in response to myeloid modulators, FLT3L, SCF and SDF-1α. Consistent with its role in cancer cell survival, potentiated levels of p-Akt and p-S6 were lower in CRs and elevated in clinical NRs, although the two clinical categories were not mutually exclusive since several NR samples had low potentiated PI3K pathway activity. 
     Moreover, alternative mechanisms of refractoriness could arise from increased DDR, failure to undergo DDR and/or inoperative communication between DDR and apoptosis. For a response to a DNA damaging agent, DNA lesions recruit multi-protein DNA damage sensor complexes that associate with DNA damage transducer proteins such as ataxia telangectasia mutated (ATM), a kinase which upon activation phosphorylates Thr68 (T68) of the checkpoint kinase Chk2. The resultant delay in cell cycle progression provides cells with a chance to repair the DNA damage. If repair fails, cells undergo apoptosis. In this study three DDR/apoptosis profiles distinguished AML samples. In the first, minimal p-Chk2 response was observed and consequently no apoptotic response. In the second profile there seemed to be a failure for DDR to translate into apoptosis and in the third, DDR, apoptosis and their communication was intact. Notably, all clinical responsive patients fell into this latter category. Further sample cohorts are needed to see whether this association between in vitro apoptotic sensitivity and clinical response holds, potentially providing a valuable means for predicting clinical outcomes. 
     The robust activation of two major survival pathways shown in a subset of AML samples provided a rationale for evaluating apoptotic proficiency in this sample cohort. In vitro exposure of samples to etoposide and staurosporine, two agents that induce apoptosis by different mechanisms, identified distinct blast subsets with different responses to each agent between individual samples and also within the same sample. Samples sensitive to both agents were taken from CR patients. However, this apoptotic proficiency was also observed in some NR patient samples. There are several explanations to account for the unexpected in vitro apoptotic response of NR samples, principally that the in vitro apoptotic responses were not measured with the drugs used clinically (Ara-C/Daunorubicin) by which the NRs were categorized. Further, although Etoposide, Ara-C and Daunorubicin all induce DNA damage they have different mechanisms of action and are substrates for different transporters and thus might not mimic the in vivo responses. It is also possible that the AML biology characterized for these samples is not represented by clinical definitions of NR and CR. Furthermore, in all cases, only a fraction of cells undergo apoptosis and the phenotype of the non-responding cells may account for the apparent disconnect between apoptosis seen in vitro versus the clinical NR. 
     In order to understand whether there was a link between signaling by survival pathways and in vitro apoptotic responses, correlations were computed. When evaluated for Jak/Stat and PI3K pathway activity, most samples refractory in vitro to either or both etoposide and staurosporine had a cell subset that displayed potentiated PI3K signaling. In contrast, samples refractory to staurosporine displayed elevated Jak/Stat pathway activity whereas there were variable levels of Jak/Stat pathway activity across a range of etoposide induced responses. Given the fine balance between levels of p-Stat 5 that, via a transcriptional program in vivo, regulate blast cell proliferation versus disruption of differentiation, the in vitro experimental conditions utilized here may not have allowed these more subtle changes to be observed between Stat activity and DDR induced apoptosis. It is very likely that these two common survival pathways are playing a major role in conferring refractoriness to chemotherapy, but that alternative, as yet unrevealed, pathways also make a contribution. 
     Several AML samples within this cohort had two blast cell populations discernible by their surface phenotype suggestive of cell populations representing different stages of differentiation. Of the two samples described in this manuscript, SCNP revealed that each blast cell population had its own distinct signaling and apoptosis profiles. Given the opportunity to apply SCNP assays to samples taken over time from the same patient it may be possible to determine which blast population confers refractoriness to chemotherapy. 
     Further correlations to defined genetic abnormalities driving these signaling observations could underscore their potential roles in driving AML disease; such as analysis of intracellular signaling pathways in the context of FLT3 mutational status. The output from such studies could be to guide the choice of available investigational and approved agents to provide benefit for AML patients refractory to current chemotherapy regimens. 
     These data also demonstrate the applicability and utility of using principle component analysis as a metric that can be used to stratify patient data according to signaling pathway response. However, these data also suggest accuracy of stratification can be improved by first identifying distinct sub-populations of AML blasts. For example, the diversity of different signaling pathway responses in NR AML was observed not only within a heterogeneous of samples but also within the same blast from a sample. Likewise, different sub-populations of cells in a single sample demonstrated different sensitivities to apoptosis, as demonstrated in  FIG. 30 (panel b). Therefore, these results demonstrate the applicability of sequential analyses such as decision trees or gating analyses, to AML sample data in order to identify and characterize variation in signaling pathway response in distinct sub-populations of heterogeneous AML samples. The identified signaling pathway responses may then be statistically associated with apoptosis profiles that can be used to inform patient treatment. 
     Samples associated with a multiplicity of sub-populations with different signaling pathway responses can be further characterized according to the relative amounts of each sub-populations (e.g. by a percentage values or ratios). Reports may be generated for physicians that characterize the sub-populations of an AML sample, their relative amounts and the unique biology (e.g. mutational status, signaling mechanisms, etc.) allowing physicians to make informed treatment decisions based on the heterogeneity of the patient&#39;s leukemia. 
     Example 11 
     SCNP assays were performed on 77 bone marrow samples from pediatric AML patients enrolled in POG trial 9421 of which 67 were evaluable/had sufficient data for analysis and were enriched for non-responders (NR). 80 combinations of modulators and intra-cellular proteins (signaling nodes) were investigated including nodes involved in the phosphoinositide 3-kinase (PI3K), Janus Kinases (JAK), signal transducers and activators of transcription (STAT) and the DNA damage response and apoptosis pathways. Basal and modulated protein levels in leukemic blasts were measured using several metrics (e.g., fold change, total level of phosphorylation, and a rank based method Uu measuring the proportion of cells that shift from baseline), and nodes were examined in univariate and multivariate analyses for their ability to discriminate between AML responsive (CR, n=46) and non-responsive (NR, n=21) to anthracycline/cytarabine-based induction therapy. Furthermore, nodes were examined for their ability to identify patients likely to be in complete continuous remission (CCR, n=23) or relapse (CR-Rel, n=23) within 4 years. Univariate analysis revealed 19 nodes associated with disease response to conventional induction therapy and 9 associated with CR-Rel (i.e., area under the operator/receiver curve (AUC of ROC)&gt;0.65; p&lt;0.05). As in adult studies, nodes involved in the apoptotic response to agents inducing DNA damage (e.g., etoposide→c-PARP AUC 0.83, AraC+Daunorubicin→c-PARP AUC 0.76, AraC+Daunorubicin→p-Chk2 AUC 0.71) showed higher levels of apoptosis in CR samples than in NR samples. Similarly, FLT3 and SCF phosphorylation levels of PI3K pathway members S6 (AUC 0.70) and ERK (AUC 0.65) were also higher in CR samples, while hydrogen peroxide as a modulator (acting either as a reactive oxygen species or as a phosphatase inhibitor) revealed lower p-Akt and p-PLC gamma levels in NR samples (AUC 0.70 for both). In multivariate analysis combination of 2-8 nodes (representing apoptosis, Jak/Stat and PI3K pathways) resulted in classifiers with good performance characteristics (bootstrap adjusted AUC 0.84-0.88) in predicting response to induction therapy. Increased sensitivity to etoposide and anthracycline/cytarabine was also associated with CCR in univariate analysis (AUC 0.77 and 0.68 respectively). Thapsigargin, a modulator known to raise intracellular calcium, induced p-Erk, p-CREB and p-S6 less in CR-Rel than in CCR samples. To predict the response to therapy, multivariate classifiers were better than individual nodes at discriminating between CR-Rel and CCR groups (adjusted AUC&gt;0.8). Additional analyses that evaluate independence and ability to combine clinical or molecular predictors (e.g., cytogenetics, FLT3-ITD) with SCNP data will be presented. Tables 32 and 33 show important nodes for stratifying pediatrics patients into CR vs. NR (Table 32) and relapse (Table 33). 

 
     
       
         
           
               
             
               
                 TABLE 33 
               
             
            
               
                   
               
               
                 Important nodes for stratifying CR-Rel vs. CCR 
               
            
           
           
               
               
            
               
                 Node 
                 Importance 
               
               
                   
               
               
                 G-CSF*15_0_*3*None*p-Stat5_Y694_*Red_C-A*AdjFoldP1 
                 0.458 
               
               
                 Unstim/No Modulator*360_0_*1*None*Cleaved PARP_D214_*Blue_E-A*Ua 
                 0.422 
               
               
                 Unstim/No Modulator*360_0_*1*0.1_DMSO*Cleaved PARP_D214_*Blue_E-A*Ua 
                 0.379 
               
               
                 Thapsigargin*15_0_*5*0.05_DMSO*p-CREB_S133_*Blue_D-A*AdjFoldP1 
                 0.366 
               
               
                 Etoposide*360_0_*1*0.1_DMSO*Cleaved PARP_D214_*Blue_E-A*Ua 
                 0.365 
               
               
                 Etoposide*360_0_*1*0.1_DMSO*Cleaved PARP_D214_*Blue_E-A*Uu 
                 0.356 
               
               
                 Thapsigargin*15_0_*5*0.05_DMSO*p-ERK 1/2_T202/Y204_*Red_C-A*AdjFoldP1 
                 0.319 
               
               
                 IL-3*15_0_*3*None*p-Stat5_Y694_*Red_C-A*Ua 
                 0.316 
               
               
                 Thapsigargin*15_0_*5_*0.05_DMSO*p-S6_S235/236_*Blue_E-A*Ua 
                 0.306 
               
               
                 G-CSF*15_0_*3*None*p-Stat1_Y701_*Blue_E-A*AdjFoldP1 
                 0.305 
               
               
                 IL-3*15_0_*3*None*p-Stat3_S727_Blue_D-A*AdjFoldP1 
                 0.299 
               
               
                 Unstim/No Modulator*0 + 0*9*None*CXCR4*Blue_E-A*RelExpr 
                 0.298 
               
               
                 IL-27*15_0_*3*None*p-Stat5_Y694_*Red_C-A*AdjFoldP1 
                 0.292 
               
               
                 G-CSF*15_0*3*None*p-Stat5_Y694_*Red_C-A*Ua 
                 0.249 
               
               
                 Thapsigargin*15_0_*5*0.05_DMSO*p-S6_S235/236_*Blue_E-A*AdjFoldP1 
                 0.248 
               
               
                 IL-27*15_0_*3*None*p-Stat3_S727_*Blue_D-A*AdjFoldP1 
                 0.232 
               
               
                 GM-CSF*15_0_*3*None*p-Stat5_Y694_*Red_C-A*Ua 
                 0.232 
               
               
                 Ara-C + Daunorubicin-HCl*360_0_+360_0_*1*None*Cleaved PARP_D214_*Blue_E-A*Ua 
                 0.224 
               
               
                 Staurosporine*360_0_*2_*0.05_DMSO*Cleaved PARP_D214_*Blue_E-A*Uu 
                 0.218 
               
               
                 GM-CSF*15_0_*3*None*p-Stat3_S727_*Blue_D-A*AdjFoldP1 
                 0.217 
               
               
                 SCF*5_0_*7*None*p-S6_S235/236_*Blue_E-A*AdjFoldP1 
                 0.216 
               
               
                 IL-10*15_0_*3*None*p-Stat5_Y694_*Red_C-A*AdjFoldP1 
                 0.213 
               
               
                 IL-27*15_0_*3*None*p-Stat1_Y701_*Blue_E-A*AdjFoldP1 
                 0.212 
               
               
                 IL-27*15_0_*3*None*p-Stat5_Y694_*Red_C-A*Ua 
                 0.202 
               
               
                 GM-CSF*15_0_*3*None*p-Stat1_Y701_*Blue_E-A*AdjFoldP1 
                 0.197 
               
               
                   
               
            
           
         
       
     
     CONCLUSION 
     The training study data show the value of performing quantitative SCNP under modulated conditions as the basis for developing highly predictive tests for response to induction chemotherapy in pediatric patients with newly diagnosed AML. 
     Example 12 
     Modulated single cell network profiling (SCNP) was used to evaluate the activation state of intracellular signaling molecules (i.e. nodes), including phosphorylated (p)-Akt, p-Erk, p-S6, p-Stat5 and cleaved-PARP, at baseline and after treatment with specific modulators [including cytokines (such as IL-27) growth factors (such as FLT3 ligand) and drugs (such a cytosine arabinoside)] in 7 healthy bone marrow mononuclear blasts (BMMb) and leukemic myeloblasts, characterized for FLT3 receptor mutation status, from 44 AML patients (38 FLT-WT and 6 FLT3-ITD), aged &gt;60 years (ECOG trial E3999). A total of 64 node-metrics were analyzed. 
     Signaling profiles differed significantly in FLT3-ITD vs. FLT3-WT AML, and in FLT3-WT vs. BMMb (shown in  FIG. 35  for a representative node, FLT3 ligand induced p-S6). Specifically, compared to BMMb, FLT3-ITD blasts uniformly showed increased basal p-Stat5 levels, decreased FLT3 ligand-induced activation of PI3K and Raf/Ras/Erk pathways, minimal IL-27 induced activation of the Jak/Stat pathway, and higher apoptotic responses to DNA-damaging agents. Two AMLs harboring a low FLT3-ITD mutant burden, however, exhibited a signaling pattern similar to FLT3-WT AMLs. By contrast, FLT3-WT samples displayed heterogeneous signaling profiles, overlapping both with those of FLT3-ITD and BMMb samples, suggesting that a fraction of FLT3-WT AML exhibit FLT3 receptor pathway deregulation even without FLT3-ITD. Conclusions This study showed that SCNP, which provides a detailed view of intracellular signaling networks at the single-cell level, subclassified patients with AML beyond their molecularly determined FLT3 mutation status. In particular, a fraction of FLT3-WT AML signaled as if containing a FLT3 receptor length mutation while FLT3-ITD with low mutational load signaled like FLT3-WT AMLs. The clinical relevance of this observation, both for disease prognosis and response to kinase inhibitors, will be revealed only if AML patients are accrued to kinase inhibition trials irrespective of FLT3 receptor mutation status. The wide range of signaling responses observed in FLT3-WT AML suggests that disease across FLT3-WT patients is heterogeneous, likely promoted through distinct mutations and alterations, giving rise to distinct signaling profiles in individual patients Our data also provide evidence for the co-existence of differentially signaling blast populations in individual patients. The potential impact of signaling heterogeneity on clinical response needs to be assessed and may require an individualized combination of treatment modalities. 
     Example 13 
     We combined signaling pathway analysis and drug response profiling in Acute Myeloid Leukemia (AML) samples using Single Cell Network Profiling (SCNP) assays. This technology allow for the simultaneous measurement of the activation state of multiple signaling proteins at the single cell level. 
     Cryopreserved peripheral blood mononuclear cell (PBMC) blood samples from patients with AML (N=6) were analyzed in two experimental arms. #1 Signaling Arm: The effect of various kinase inhibitors—tandutinib (Flt3); GDC-0941 (PI3Kinase); CI-1040 (MEK); CP-690550 (JAK3 and JAK2); and rapamycin (mTor)—on multiple signaling proteins in the JAK/STAT, MAPK, PI3K, and mTor pathways was measured in the basal and evoked condition (via 15 minutes growth factors stimulation) with various fluorochrome labeled phospho-specific antibodies in cell subsets defined by the expression of CD34, cKit, CD3, and light scatter properties. #2 Apotosis/Cytostasis Arm: The leukemic cells were driven into cell cycle using IL-3, stem cell factor, and Flt3 ligand, followed by a 48-hr incubation with a combination of one to five aforementioned kinase inhibitors for a total of 30 treatments per sample. The TKIs impact was measured on distal functional readouts, including apoptosis (cleaved PARP) and cell cycle (CyclinB1-S/G2 phase; p-Histone H3-M phase). All results were compared with results from bone marrow samples from healthy donors (N=6). 
     Each patient&#39;s sample generated a unique signaling profile after short modulation with growth factors (SCF, Flt3L, IL-27, G-CSF) with a broad range of responses (e.g. the percentage of SCF, G-CSF and FLT-3L responsive cells ranged between 6%-49%, 3%-56%, and 3%-22% respectively). The magnitude of signaling (fluorescence change from basal state) was also quantified in multiple cell subsets defined by surface receptor expression. Overall, patient samples could be grouped based on their signaling profile, proliferative potential, and sensitivity to kinase inhibitor treatment. Specifically, two samples with the greatest SCF and G-CSF signaling response also showed the most robust in vitro proliferation and were most sensitive to the JAK inhibitor CP-690,550 (1 μM) (as measured by cytostasis readouts). Whereas, two other samples that displayed only modest SCF and G-CSF signaling, but robust Flt3L signaling expanded slowly in culture and were particularly sensitive to the cytostatic effects of GDC-0941 (1 uM) or tandutinib (1 uM), both as single agent and in combination. Finally, the last two AML samples had weak growth factor signaling and did not proliferate in culture and therefore could not be tested for drug induced cytostasis. Of note, each individual patient sample showed distinct sensitivity (as measured by cytostasis and apoptosis) to different drug combinations. This was in contrast to the bone marrow samples from healthy donors which showed considerable similarity in response across all inhibitor combinations. 
     This study provides data for the utility of SCNP to dissect the pathophysiologic heterogeneity of hematologic tumors and assess their differential response to single and combination therapies. Ultimately, this functional pathway profiling and drug sensitivity assay could be used in a clinical trial setting to stratify patients. 
     Example 14 
     To compare the results of SCNP assays between paired fresh and cryopreserved samples in a multicenter prospective study. 13 fresh BM and PB samples were prospectively collected from pediatric or adult non-M3 AML patients at 3 academic centers and shipped over night. Samples were required to have 2 million viable cells per aliquot for SCNP assays, and underwent ficoll separation and mononuclear cells were divided into 2 aliquots—one processed fresh, and the second cryopreserved for 1 month, and then thawed and processed for the SCNP assay. 70 SCNP node-metrics (i.e. proteomic readouts in the presence or absence of modulator), identified previously as candidate proteomic signatures for several assays in development (including PIK3, Jak/STAT and DNA damage/apoptosis pathways) were investigated. The assay readouts for blast cells from a fresh aliquot were compared to the results from a cryopreserved aliquot by linear regression, Bland-Altman, and Lin&#39;s concordance analysis. 
     The analysis of paired aliquots from 13 patients, with median WBC of 27.9 (3-60) 10e3/ul, showed that cryopreservation did not affect sample quality as measured by percent of cells that were negative for cleaved PARP expression (R 2 =0.92 cryopreserved vs. fresh). The majority of unmodulated node-metrics (59%) and modulated node-metrics (68%), see Table 34, had a good correlation between the two preparations as measured by linear regression i.e., R 2 &gt;0.64. The node-metrics with a lower R 2  were using either a dim fluorophore (i.e. Alexa-647) and/or were within the low signal range (e.g., Erk basal); and therefore were not good candidates for future test development. Results using both Bland Altman and Lin&#39;s Concordance methods showed good concordance. 
     These studies highlight the importance of cryopreservation of AML samples at clinical sites and by cooperative groups. These results demonstrate that cryopreservation maintains the activation signaling potential of AML blasts. SCNP assays developed and validated using cryopreserved samples can be applied to fresh samples and integrated prospectively into frontline clinical trials and clinical practice. 
     
       
         
           
               
             
               
                 TABLE 34 
               
             
            
               
                   
               
               
                 Goodness of fit (R 2 ) values from regressing  
               
               
                 Cryo against Fresh for modulated mode-metrics.  
               
               
                 Fold and U u  (rank based) metrics measure changes in  
               
               
                 signaling protein levels due to modulation.  
               
            
           
           
               
               
               
               
               
               
            
               
                   
                   
                 Assay 
                   
                 R 2  for 
                 R 2  for 
               
               
                   
                 Modulator 
                 Read-out 
                 Color 
                 Fold 
                 U u   
               
               
                   
                   
               
            
           
           
               
               
               
               
               
               
            
               
                   
                 Cytarabine + 
                 cPARP 
                 FITC 
                 0.71 
                 0.63 
               
               
                   
                 Daunorubicin 
                 pChk2 
                 A. 647 
                 0.38 
                 0.37 
               
               
                   
                 Etoposide 
                 cPARP 
                 FITC 
                 0.78 
                 0.49 
               
               
                   
                   
                 pChk2 
                 A 647 
                 0.52 
                 0.37 
               
               
                   
                 FLT3L 
                 pAkt 
                 A 647 
                 0.13 
                 0.09 
               
               
                   
                   
                 pErk 1/2 
                 PE 
                 0.46 
                 0.55 
               
               
                   
                   
                 pS6 
                 A 488 
                 0.89 
                 0.94 
               
               
                   
                 G-CSF 
                 pStat1 
                 A 488 
                 0.73 
                 0.72 
               
               
                   
                   
                 pStat3 
                 PE 
                 0.88 
                 0.94 
               
               
                   
                   
                 pStat5 
                 A 647 
                 0.89 
                 0.85 
               
               
                   
                 H 2 O 2   
                 pAkt 
                 A 488 
                 0.79 
                 0.85 
               
               
                   
                   
                 pPLCy2 
                 PE 
                 0.83 
                 0.89 
               
               
                   
                   
                 pSlp76 
                 A 647 
                 0.80 
                 0.82 
               
               
                   
                 IL-27 
                 pStat1 
                 A 488 
                 0.92 
                 0.93 
               
               
                   
                   
                 pStat3 
                 PE 
                 0.94 
                 0.90 
               
               
                   
                   
                 pStat5 
                 A 647 
                 0.93 
                 0.92 
               
               
                   
                 PMA 
                 pCreb 
                 PE 
                 0.92 
                 0.93 
               
               
                   
                   
                 pErk 1/2 
                 A 647 
                 0.94 
                 0.90 
               
               
                   
                   
                 pS6 
                 A 488 
                 0.93 
                 0.92 
               
               
                   
                 SCF 
                 pAkt 
                 A 647 
                 0.49 
                 0.09 
               
               
                   
                   
                 pErk 1/2 
                 PE 
                 0.15 
                 0.18 
               
               
                   
                   
                 pS6 
                 A 488 
                 0.86 
                 0.75 
               
               
                   
                   
               
               
                   
                 A = Alexa 
               
            
           
         
       
     
     Example 15 
     Objectives: 
     The objective of this study was to compare by SCNP the functional effects of a panel of compounds simultaneously on different signaling pathways (such as the phosphoinositide 3-kinase (PI3K) and the Janus Kinases (Jak) signal transducers and activators of transcription (Stat) pathway) relevant both to the biology of the disease and the development of new therapeutics, in paired, diagnostic, cryopreserved PB mononuclear cells (PBMC) and BMMC samples from 44 AML patients. A paired sample was defined as a BMMC and PBMC specimen collected from the same patient on the same day. 
     Methods: 
     Modulated SCNP using a multiparametric flow cytometry platform was used to evaluate the activation state of intracellular signaling molecules in leukemic blasts under basal conditions and after treatment with specific modulators (Table 35). The SCNP phosphoflow assay was performed on 88 BMMC/PBMC pairs from ECOG trial, E3999. The relationship between readouts of modulated intracellular proteins (“nodes”) between BMMC and PBMC was assessed using linear regression, Bland-Altman method or Lin&#39;s concordance correlation coefficient. 
     Table 35 shows the goodness of fit (R 2 ) values from the linear regression analysis for both the basal levels and the modulated levels of intracellular signaling proteins. Most of the signaling nodes show strong correlations (R 2 &gt;0.64) with several of the exceptions belonging to nodes with weak response to modulation (e.g. SCF-&gt;p-Akt) or antibodies with dim fluorphores (i.e. Alexa 647). The lack of response is however, consistent between the tissue types for the weak response nodes. Using a rank based metric that is less sensitive to the absolute intensity levels seem to perform better for the antibodies with dim fluorophores. Results from other methods; Bland Altman and Lin&#39;s Concordance also show good concordance between the tissue types. 
     The data presented here demonstrate: 1) Specimen source (BM or PB) does not affect proteomic signaling in patients with AML and circulating blasts. 2) PB myeloblasts can be used as a sample source for Nodality SCNP assays to identify functionally distinct leukemic blats cell populations with distinct sensitivities to therapy. 3) The ability to use PB as a sample source will greatly improve the utility of these assays. In particular, our results will facilitate the monitoring of cellular signaling effects following the administration of targeted therapies, e.g., kinase inhibitors, at time-points when BM aspirates are not clinically justifiable. 

 
     One method of further improving the concordance between PB and BM specimens could be to adjust the biological measurements by a measure of the presence of subpopulations within the leukemic sample, or by differences in the cell maturity of subpopulations. This could be done for example by measuring the relative presence of CD34+ cells in PB and BM leukemic samples and adjusting the signaling of each tissue based on the % of CD34+ cells in the tissue type. Similarly the signaling or biological measurements of each cell within the sample could be scaled or adjusted according to the relative expression of a specific surface marker on that cell such as CD34 or CD11b or another marker of cell lineage or cell maturity. 
     Example 16 
     SCNP assays were performed on paired, bone marrow (BM) and peripheral blood (PB), samples from 44 AML patients (de novo, evolved from an antecedent MDS or MPN or treatment related), &gt;60 years old, enrolled on ECOG trial E3999. Based on two previous training studies, 38 combinations of modulators and intra-cellular proteins (signaling nodes along the phosphoinositide 3-kinase (PI3K), the Janus Kinases (Jak) signal transducers and activators of transcription (Stat) and the DNA damage response and apoptosis pathways) were investigated. Basal and modulated protein levels and the effect of modulation on proteins levels in the leukemic blast cells were expressed using a variety of metrics. A total of 64 node/metric combinations (dimensions) were used to build multi-parametric classifiers (ranging from 2 to 10 nodes/metrics) using different modeling methodologies (including random forest, boosting, lasso and a bootstrapped best subsets logistic modeling approach that shrinks regression coefficients (BBLRS)) able to predict the likelihood of response to induction therapy. The performance characteristics of the classifiers built on the BM samples were then evaluated independently on the paired PB samples, 
     Several promising models with high area under the operator/receiver curve (AUROC) values (indicating strong agreement between actual clinical responses and responses as predicted by the model) were developed based on SCNP proteomic read outs for BM samples. The observed and predicted values from the current best BBLRS model are shown in  FIG. 34 . The unadjusted AUROC of this model is 0.98 and the expected AUROC for the model when applied to an independent (validation) sample is 0.84. Five signaling nodes are represented in this model; they include nodes belonging to growth factor-induced survival pathways (PI3K, RAS/MAPK) as well as DNA damage response and apoptosis pathways. When the predictive accuracy of the lead SCNP classifier was compared to that of a model based on traditional clinical/molecular predictors (i.e. the combination of age, therapy-related AML, and karyotype) the adjusted AUROC of the SCNP classifier far surpassed that of the clinical predictors (adjusted AUROC=0.61 for clinical/molecular predictors vs. adjusted AUROC=0.84 for the SCNP classifier). Finally, when the nodes in the best BBLRS model developed on data from BM samples were used to model read outs from the paired PB samples, the adjusted AUROC of the resulting BBLRS model was comparable to that of the model fit to BM samples. 
     This training set data show the value of performing quantitative SCNP under modulated conditions as the basis for developing highly predictive tests for response to induction chemotherapy. Most importantly, the predictions made by the SCNP classifier are independent of established prognostic factors, such as age and cytogenetics The ability of one set of nodes to accurately predict response in paired BM or PB samples from individual patients suggests that the predictive power of the SCNP assay is independent of sample source, further improving the practicality of the test. Independent validation studies are ongoing. 
     Example 17 
     In pediatric de novo AML, cytarabine (Ara-C)-based induction therapy results in above 80% complete response (CR) rates but nearly half of those who achieve an initial remission relapse die of their disease. Accurate prediction of initial response to chemotherapy at the time of diagnosis as well as identification of those at high risk of relapse despite initial remission would allow for patient specific therapy and improved clinical outcome. In a previous study, we used this assay to define two distinct classifiers associated with response to standard induction therapy and risk of relapse in diagnostic bone marrow mononuclear cells from pediatric patients (pts) with non-M3 AML (ASH 2010; 116:Abstract 954). See Example 11. This study confirmed the validity of the pre-specified response to induction therapy classifier in an independent set of AML pediatric patients. 
     The SCNP-based response classifier developed using 53 AML cryopreserved samples from patients enrolled on POG (now COG) trial 9421 (see example 11) was comprised of a combination of three SCNP readouts that measure apoptosis, MAPK signaling, and PI3K signaling and had a bootstrapped out-of-bag estimated Area Under the Receiver Operating Characteristic Curve (AUROC) of 0.84 (95% CI 0.67-0.96). The classifier was tested on 68 cryopreserved samples (20 non-responders (NR) and 48 CRs) from patients enrolled on COG trials AAML0531 (samples from patients randomized to Ara-C, Daunomycin and Etoposide [ADE] induction therapy) and AAML03P1 (samples from patients treated with ADE plus Gemtuzumab Ozogamicin induction therapy). The primary hypothesis was that the prediction of induction response by the continuous score from the pre-specified classifier would yield an AUROC significantly greater than 0.5. 
     The primary objective of the study was met with an AUROC of 0.66 (n=68) p=0.042 (see Table 36). The primary analysis used an NR classification that combined patients with either induction failure (n=14) or induction death (n=6). A pre-specified analysis in which induction deaths were removed resulted in an AUROC of 0.70 (n=62) p=0.021, suggesting that the underlying disease biology may be different for induction death vs. induction failure. In this study, White Blood Cell count (WBC) and cytogenetics risk groups were associated with induction response while age, gender and FLT3-ITD status were not. In a multivariate analysis of induction response that included WBC, cytogenetics and the pre-specified continuous SCNP classifier score, only cytogenetic risk group (p=0.001) and SCNP score (p=0.017) remained significant. Exploratory analyses excluding induction deaths suggest that the relationship between the SCNP score and induction response is strong among patients with an intermediate cytogenetic classification (n=23) (AUROC=0.88, p=0.002), while no relationship (AUROC=0.48, p=0.959) is seen in those patients with a poor cytogenetic classification (n=17). Among the three SCNP signaling nodes contributing to the score, the node measuring drug-induced apoptosis performs most consistently across the training and validation sets. 
     
       
         
           
               
             
               
                 TABLE 36 
               
             
            
               
                   
               
               
                 Bias correct accelerated bootstrap method  
               
               
                 was used for AUROC and  
               
               
                 Wilcoxian exact test was used for p-value. 
               
            
           
           
               
               
               
               
            
               
                   
                   
                 AUROC  
                 p-value  
               
               
                   
                 Pre-specified Analysis 
                 (95% Cl) 
                 (sample size) 
               
               
                   
                   
               
               
                   
                 Primary 
                 0.66 (052, 078)  
                 0.042 (n + 68) 
               
               
                   
                 Induction deaths removed 
                 0.70 (55, 0.83)  
                 0.021 (n + 62) 
               
               
                   
                   
               
            
           
         
       
     
     
       
         
           
               
             
               
                 TABLE 37 
               
             
            
               
                   
               
               
                 SCNP Nodes for classifier 
               
            
           
           
               
               
               
               
            
               
                 SCNP  
                 SCNP  
                   
                   
               
               
                 Modulator 
                 Readout 
                 Metric 
                 Coefficient 
               
               
                   
               
            
           
           
               
               
               
               
            
               
                 Intercept 
                   
                   
                 −4.4032 
               
               
                 Etoposide 
                 cPARP 
                 AdjU U   
                 7.0139 
               
               
                 Thapsigargin 
                 p-Erk 
                 Log2(AdjFold) 
                 −1.3572 
               
               
                 FLT3L 
                 p-S6 
                 Log2(AdjFold) 
                 0.7843 
               
               
                   
               
            
           
         
       
     
     The locked classifier had a bootstrapped out of bag estimated AUROC of 0.84 (95% C1-0.96) and components of the locked logistic regression model shown in Table 37. The continuous classifier score is defined as the probability of a patient achieving a complete response, as calculated by the model. Accuracy of the SCNP model was found to be highest in the intermediate cytogenetic risk subgroup. Also, the SCNP was found to have good reproducibility. 
     Example 18 
     FMS-like tyrosine kinase 3 (FLT3) internal tandem duplication (ITD) mutations (FLT3 ITD+) result in constitutive activation of this receptor and have been shown to increase the risk of relapse in patients (pts) with AML; however, substantial heterogeneity in clinical outcomes still exists within both the FLT3 ITD+ and FLT3 ITD-AML subgroups, suggesting alternative mechanisms of disease relapse not accounted for by FLT3 mutational status. Single Cell Network Profiling (SCNP) is a multiparametric flow cytometry-based assay that simultaneously measures, in a quantitative fashion and at the single cell level, both extracellular surface marker levels and changes in intracellular signaling proteins in response to extracellular modulators (Kornblau et al. Clin Cancer Res 2010). Previously, we reported the use of this assay to functionally characterize FLT3 receptor signaling in healthy bone marrow and AML samples (Rosen et al. PLoS One 2010). By applying it to a separate cohort of samples collected from elderly non-M3 AML pts at diagnosis, a subclassification of AML samples beyond their “static” molecular FLT3 ITD status was generated (Rosen et al. ASH 2010 Abstr 2739). Specifically, FLT3 ITD− AML samples displayed a wide range of induced signaling, with a fraction having signaling profiles comparable to FLT3 ITD+AML samples. Conversely, FLT3 ITD+AML samples displayed more homogeneous induced signaling, with the exception of those with low mutational load, which had profiles more analogous to FLT3 ITD− AML samples. Due to the small numbers of pts in that exploratory study (n=44 [38 FLT3 ITD− and 6 FLT3 ITD+ pts]), an independent study was undertaken to confirm the observations, as well as to evaluate their clinical relevance (i.e., association with disease free survival (DFS) following anthracycline/cytarabine-based induction therapy. 
     SCNP was performed as previously described on cryopreserved bone marrow or peripheral blood samples collected prior to anthracycline/cytarabine-based induction therapy from 104 elderly (&gt;60 y) non-M3 AML pts enrolled on ECOG trial 3999 or 3993 for whom ITD mutational status (including % mutational load), response and DFS data were available. Samples included 85 FLT3 ITD- and 19 FLT3 ITD+AML, 30 and 8 of which, respectively, were collected from patients who achieved complete remission (CR). 
     The primary study objective was to confirm that levels of FLT3 ligand (FLT3L)-induced signaling (as measured by changes in intracellular phospho-S6 level) are more homogeneous in FLT3 ITD+ than in FLT3 ITD− myeloblasts. Four FLT3 ITD+ groups were pre-defined based on % mutation load (&gt;0, 30%, 40%, or 50%). In addition, FLT3 ITD mutational status and signaling data from the SCNP assay (FLT3L and stem cell factor-induced phospho-S6 signaling and cytarabine/daunorubicin-induced apoptosis [cleaved PARP]) were combined to mathematically model their association with DFS among pts who achieved CR. DFS was defined as time from date of confirmed CR to date of relapse or death. 
     Our previous observations that variance in FLT3L-induced signaling is higher in FLT3 ITD-AML samples than in FLT3 ITD+ ones and that variance is decreased with increasing mutational load were verified in this study (Levene Test for FLT3 ITD− vs FLT3 ITD+50 p value=0.023). Further, when the association of DFS with FLT3 ITD mutational status and signaling data from the SCNP assay was measured using a Cox Proportional-Hazards model, the SCNP data were shown to provide independent information from FLT3 ITD mutational status (p=0.0115 for FLT3L-induced phospho-S6 signaling. See the  FIGS. 1 a  and 1 b    from U.S. Ser. No. 61/515,660. 
     These data add to the growing body of evidence that, even within currently accepted risk stratification groups, AML is a heterogeneous disease. Functional characterization of FLT3 receptor signaling deregulation using SCNP provides prognostic information independent from FLT3 ITD mutational status and allows for more accurate pt stratification by functionally defining DFS risk sub-groups. Characterization of FLT3 signaling deregulation by SCNP could ultimately aid in the improved clinical management of AML pts and help identify candidates for FLT3 receptor inhibitor studies. 
     Example 19 
     Validation study to confirm the accuracy of the assay in predicting complete continuous response to Cytarabine-based induction therapy in elderly patients with non-M3 AML using samples from SWOG studies S9031, S9333, S0112 and S0301. 
     This protocol focuses on the validation of the SCNP classifier for prediction of CCR1 after standard induction therapy using AML samples collected at time of diagnosis (“pre-treatment”), with an immature phenotype (determined using a pre-specified classifier based on expression of the surface markers CD34, CD45, CD117 and FSC (Forward Scatter Characteristics)). 
     To validate the accuracy of the assay, continuous score with final components (i.e. final, specified reagent formulations, assay configurations, instrumentation, software, SCNP classifier) to predict CCR1 following cytarabine-based induction chemotherapy in patients 56 years of age or older with non-M3 AML using pre-treatment PB/BM samples with an immature phenotype (one sample per patient). 
     This is a validation study in which samples from patients 56 years of age or older with non-M3 AML are used to test the accuracy of the assay. 
     The clinical samples and related clinical patient annotations were previously collected by SWOG as part of studies S9031, S9333, S0112, and S0301 (referred to as parent studies). For this study, 193 cryopreserved pre-treatment samples (PBMCs and/or BMMCs samples) belonging to 130 patients were processed alongside samples from the SWOG Training study 2009014. 
     Eligible patients were 56 years or older with non-M3 AML at time of enrollment onto one of 4 SWOG treatment protocols using cytarabine-based induction therapy (SWOG study IDs: S9031, S9333, S0112 and S0301). Eligible patients had 2 or more remaining aliquots of a pre-treatment sample (PB and/or BM) at the SWOG biobank, had consented for research use of their sample(s), and had initiated (i.e. received at least one dose of) SWOG protocol-specified induction therapy. In addition, eligible patients must have had one of the following clinical outcomes: CCR1 (complete continuous response with duration of ≧1 year), non-CCR1 (i.e. complete response with duration of &lt;1 year or resistant disease (RD)) or treatment-related death/early death (TRD/ED). 
     A patient sample is considered eligible if at least 25% of the leukemic-blast cells are in the “healthy” gate (cell health assay, see PCT/US2011/48332) and sufficient cells were recovered after thawing to generate and acquire data for the core SCNP assay conditions. 
     A total of 193 samples from 130 (eligible) patients were processed in this study. Both patients and samples need to be evaluable to be included in the analysis sets. There are two patient sets: all evaluable patients and all evaluable patients excluding ED/TRD. There are three evaluable sample sets: PB samples, BM samples and the combined PB/BM sample set. The primary analysis set for this protocol includes one PB or BM sample with an immature phenotype from each evaluable patient without an ED/TRD outcome (n˜47). Samples with immature phenotype are determined computationally using a pre-specified classifier for the prediction of sample based on expression levels of a specific panel of surface markers. 
     Two batches of 14 samples each were thawed and processed in parallel (total of 28 samples/per “thaw” day). Two to four batches (28-56 donor samples) were processed per week. 
     The conditions used to process the samples, as well as assay controls, are similar to that described above. 
     The samples were incubated in 96-well plates with or without modulators, then fixed and permeabilized. The samples were then incubated with a cocktail of fluorochrome-conjugated antibodies that recognize extracellular lineage markers and intracellular epitopes, for phosphorylated sites on signaling proteins, and proteolytic cleavage sites for indicators of apoptosis. 
     The viability dye and lineage markers/gating antibodies used for the assay panel were: AmineAqua, anti-CD34, and anti-CD45. Anti-cPARP antibody was included in each well to allow gating on cPARP-negative cell populations. 
     Primary Objective: To validate the accuracy of the assay continuous score with final components (i.e. final, specified reagent formulations, assay configurations, instrumentation, software, SCNP classifier) to predict CCR1 following cytarabine-based induction chemotherapy in patients 56 years of age or older with non-M3 AML using pre-treatment PB/BM samples with an immature phenotype (one sample per patient). 
     Hypothesis: The empirical area under the receiver operating characteristic curve (AUROC), based on the SCNP Continuous Score, where higher scores indicate greater probability of CCR1 post cytarabine-based induction chemotherapy, is significantly greater than 0.5. 
     Method of Analysis: The AUROC, estimated empirically using the trapezoidal method is equivalent to several other rank-based measures of association, including the Mann-Whitney U-statistic (AUC=U/(n1+n2) and Somers&#39; D statistic (AUC=D/2+0.5), both of which represent monotonic transformations of the AUC. Since the AUC is (monotonically) equivalent to the Mann-Whitney U-statistic, and the exact test is based only on the relative ordering of scores among the two classification groups, an exact test for the Mann-Whitney U-statistic, where the null hypothesis of no association (HO: U=0) is tested against the one sided alternative (H1: U&gt;0), is equivalent to a one-sided exact test of HO: AUC=0.5 versus H1: AUC&gt;0.5. 
     We have found that CCR1 models are effective in “immature” samples. The models perform best in immature samples. An out of bag (OOB) area under the curve (AUC) is about 0.9 in immature samples and about 0.5 in mature samples. Accounting for maturity at single cell level improves CCR1 model only marginally. Extensively modeling was pursued in order to improve CCR1 model performance, without success. All samples had an AUC of about 0.75. The analysis sets of CCR1 modeling showed OOB AUC including paired PB/BM samples. Immature samples had an AUC of 0.89 (N=34 PB, 25 BM). Mature samples had an AUC of 0.48 (N=23 PB, 18 BM). 
     The computational model to predict sample maturity was refined further to include additional phenotypic markers. One model for sample maturity has an operator-based assignment by an expert using flow plots of phenotypic markers as the Gold standard. We also look to develop model to computationally assign maturity category using surface marker expression, preferably using markers available in each well of SCNP assay (CD34, CD45). The model was refined after a decision to focus on the immature subset of samples. The new model focused on predicting maturity at the sample level, rather than individual cells. The model now incorporates an expanded repertoire of surface markers and scatter properties, such as FSC, CD45, CD34, and CD117. 
     For example, in one embodiment, version 1 of the model for sample maturity can be applied to individual cells using CD34 and CD45. Version 2 can be applied only at sample level using FSC, CD45, D34, and CD117. Using either version, the model will obtain predicted immature samples (Apply CCR1 Model (˜62% of donors) and predicted mature samples. 
     CCR1 Model Applied After Computational Model of Maturity. The model was exclusively applied to samples computationally predicted to be immature (N˜45: 62% of samples). For CCR1 model-building, tissue (PB/BM) type was randomly sampled from donors with both sample types. In the CCR1 model the results showed that OOB AUC in Immature Samples: 0.85, OOB AUC in Mature Samples: 0.5, 100 bootstraps in each sample and coefficients/AUC vary somewhat under random sampling above. The summary of models is shown below in Table 38. 
     
       
         
           
               
             
               
                 TABLE 38 
               
             
            
               
                   
               
               
                 Biological Rationale 
               
            
           
           
               
               
               
               
            
               
                 Nodes 
                 Population 
                 Type 
                 Biological Rationale 
               
               
                   
               
               
                 CD34 | log2(lymphs) 
                 Leukemic  
                 Surface 
                 CD34 expression 
               
               
                   
                 Blasts 
                 Expression 
                 normalized against 
               
               
                   
                   
                   
                 lymphocytes 
               
               
                 CD135| log2(lymphs) 
                 Leukemic  
                 Surface 
                 FLT3 Receptor  
               
               
                   
                 Blasts 
                 Expression 
                 Expression 
               
               
                   
                   
                   
                 normalized against 
               
               
                   
                   
                   
                 lymphocytes 
               
               
                 FLT3L→p-Akt | Uu 
                 Healthy  
                 Signaling 
                 FLT3 Pathway  
               
               
                   
                 Leukemic 
                   
                 Activation 
               
               
                   
                 Blasts 
                   
                 via p-Akt 
               
               
                 AraC + Dauno→ 
                 Leukemic  
                 Apoptosis 
                 Reduction in proportion 
               
               
                 CD34 | Uu 
                 Blasts 
                   
                 CD34 positive cells  
               
               
                   
                   
                   
                 due to AraC + Dauno  
               
               
                   
                   
                   
                 in 24 hours 
               
               
                   
               
            
           
         
       
     
     Samples would be assayed as follows, all samples would be treated under the maturity model and separated as predicted mature or immature. The predicted immature would be treated by the CCR1 model and separated into pCCR1 and pnotCCR1. The predicted mature would be treated as non-evaluable. 
     The summary of models is shown below in Table 39: 
     
       
         
           
               
             
               
                 TABLE 39 
               
             
            
               
                   
               
               
                 CD/RD Classifier 
               
            
           
           
               
               
               
               
            
               
                 SCNP  
                   
                   
                   
               
               
                 Nodes| metric 
                 Population 
                 Type 
                 Biological Rationale 
               
               
                   
               
            
           
           
               
               
               
               
            
               
                 AraC + Dauno→  
                 Leukemic 
                 Apop- 
                 Apoptosis induced by  
               
               
                 cPARP | Uu 
                 Blasts 
                 tosis 
                 AraC + Dauno in 24 hours  
               
               
                   
                   
                   
                 measured by cleaved  
               
               
                   
                   
                   
                 PARP in surviving cells 
               
               
                 AraC + Dauno→  
                 Leukemic 
                 Apop- 
                 Decrease in proportion of  
               
               
                 CD34 | Uu 
                 Blasts 
                 tosis 
                 leukemic blast cells  
               
               
                   
                   
                   
                 expressing CD34 due to  
               
               
                   
                   
                   
                 AraC + Dauno exposure for  
               
               
                   
                   
                   
                 24 hours: Death of CD34 
               
               
                   
               
            
           
         
       
     
     Sample maturity is shown below in Table 40, and Table 41 shows CRR1 classifier. 
     
       
         
           
               
             
               
                 TABLE 40 
               
             
            
               
                   
               
               
                 Sample Maturity 
               
            
           
           
               
               
               
               
            
               
                   
                   
                   
                 Biological 
               
               
                 SCNP Nodes 
                 Population 
                 Type 
                 Rationale 
               
               
                   
               
               
                 FSC, CD45,  
                 All cells 
                 Scatter  
                 Lineage  
               
               
                 CD34, CD117 
                   
                 Properties 
                 Surface 
               
               
                   
                   
                   
                 markers 
               
               
                   
               
            
           
         
       
     
     
       
         
           
               
             
               
                 TABLE 41 
               
             
            
               
                   
               
               
                 CRRI classifier 
               
            
           
           
               
               
               
               
            
               
                 SCNP Nodes| 
                   
                   
                 Biological  
               
               
                 metric 
                 Population 
                 Type 
                 Rationale 
               
               
                   
               
               
                 CD34 | 
                 Leukemic  
                 Surface  
                 CD34 expression  
               
               
                 1og2(lymphs) 
                 Blasts (P1) 
                 Expression 
                 normalized 
               
               
                   
                   
                   
                 against lymphocytes 
               
               
                 CD135| 
                 Leukemic  
                 Surface  
                 FLT3 Receptor  
               
               
                 log2(lymphs) 
                 Blasts (P1) 
                 Expression 
                 Expression normalized  
               
               
                   
                   
                   
                 against lymphocytes 
               
               
                 FLT3L→p-Akt 
                 Healthy  
                 Signaling 
                 FLT3 Pathway  
               
               
                 | Uu 
                 Leukemic 
                   
                 Activation via p-Akt 
               
               
                   
                 Blasts  
                   
                   
               
               
                   
                 (Healthy P1) 
                   
                   
               
               
                 AraC + Dauno 
                 Leukemic  
                 Apoptosis 
                 Reduction in proportion  
               
               
                 →CD34 | Uu 
                 Blasts (P1) 
                   
                 CD34 positive  
               
               
                   
                   
                   
                 cells due to AmC + 
               
               
                   
                   
                   
                 Daunoin 24 hours 
               
               
                   
               
            
           
         
       
     
     Example 20 
     The following example incorporates by reference in its entirety Rosen et al, Leukemia Research, Vol 36, issue 7, 900-904, July 2012. 
     Chemotherapeutic agents such as cytarabine/daunorubicin (Ara-C/Dauno), are commonly used to induce disease remission in patients with acute myeloid leukemia (AML) by promoting double stranded DNA breaks (DSB), which if left unrepaired, can lead to apoptosis (Jackson and Bartek, The DNA-damage response in human biology and disease, 2009, Journal/Nature, 461, 7267, 1071-1078). Single cell network profiling (SCNP) assay using multiparametric flow cytometry measures changes in intracellular cell signaling upon exposure of live cells to extracellular modulators revealing network properties that would not be seen in resting cells (Irish, Hovland et al., Single cell profiling of potentiated phospho-protein networks in cancer cells, 2004, Journal/Cell, 118, 2, 217-228; Sachs, Perez et al., Causal protein-signaling networks derived from multiparameter single-cell data, 2005, Journal/Science, 308, 5721, 523-529; Irish, Kotecha et al., Mapping normal and cancer cell signalling networks: towards single-cell proteomics, 2006, Journal/Nat Rev Cancer, 6, 2, 146-155; Krutzik and Nolan, Fluorescent cell barcoding in flow cytometry allows high-throughput drug screening and signaling profiling, 2006, Journal/Nat Methods, 3, 5, 361-368) or in assays performed on fixed tissues. The potential usefulness of this technology to generate novel and clinically relevant biologic insights has been previously demonstrated in different diseases (Irish, Kotecha et al., Mapping normal and cancer cell signalling networks: towards single-cell proteomics, 2006, Journal/Nat Rev Cancer, 6, 2, 146-155; Perez and Nolan, Phospho-proteomic immune analysis by flow cytometry: from mechanism to translational medicine at the single-cell level, 2006, Journal/Immunol Rev, 210, 208-228; Kotecha, Flores et al., Single-cell profiling identifies aberrant STAT5activation in myeloid malignancies with specific clinical and biologic correlates, 2008, Journal/Cancer Cell, 14, 4, 335-343; Kornblau, Minden et al., Dynamic single-cell network profiles in acute myelogenous leukemia are associated with patient response to standard induction therapy, 2010, Journal/Clin Cancer Res, 16, 14, 3721-3733). More recently, SCNP assay using multiparametric flow cytometry has been used to simultaneously measure changes in DNA damage response (DDR) and apoptosis signaling pathways upon exposure of cells to extracellular modulators such as chemotherapeutics (Rosen, Cordeiro et al., Distinct signaling profiles of gemtuzumab ozogamicin responsiveness and refractoriness in acute myeloid leukemia [abstract]. 2009, Journal/Blood (ASH Annual Meeting Abstracts), 114, Abstract 2745; Cesano, Putta et al., Single-cell network profiling (SCNP) signatures independently predict response to induction therapy in older patients with acute myeloid leukemia (AML) [abstract], 2010, Journal/Blood (ASH Annual Meeting Abstracts), 116, Abstract 2695; Kornblau, Minden et al., Dynamic single-cell network profiles in acute myelogenous leukemia are associated with patient response to standard induction therapy, 2010, Journal/Clin Cancer Res, 16, 14, 3721-3733; Lacayo, Cohen et al., Single cell network profiling (SCNP) signatures predict response to induction therapy and relapse risk in pediatric patients with acute myeloid leukemia: Children&#39;s Oncology Group (COG) study POG-9421 [abstract], 2010, Journal/Blood (ASH Annual Meeting Abstracts), 116, Abstract 954; Rosen, Putta et al., Distinct patterns of DNA damage response and apoptosis correlate with Jak/Stat and PI3kinase response profiles in human acute myelogenous leukemia, 2010, Journal/PLoS One, 5, 8, e12405). Profiling these DNA repair and survival pathways at the single cell level offers insight into mechanisms of leukemia drug sensitivity and resistance and can be applied to guide patient treatment choices. 
     Materials and Methods 
     Cryopreserved peripheral blood (PBMC) or bone marrow (BMMC) mononuclear cells were obtained from patients with a new diagnosis of AML treated at British Columbia Cancer Agency or Lucile Packard Children&#39;s Hospital at Stanford University. All patients provided informed consent for research purposes. Samples were processed (thawed, modulated, fixed, permeabilized, and incubated with antibodies to both surface and intracellular proteins) as previously described (Kornblau, Minden et al., Dynamic single-cell network profiles in acute myelogenous leukemia are associated with patient response to standard induction therapy, 2010, Journal/Clin Cancer Res, 16, 14, 3721-3733; Rosen, Minden et al., Functional characterization of FLT3 receptor signaling deregulation in acute myeloid leukemia by single cell network profiling (SCNP), 2010, Journal/PLoS One, 5, 10, e13543). In this study, cellular DNA damage repair (DDR) and apoptosis were measured simultaneously in AML blasts after exposure to chemotherapeutic agents. Antibodies against phosphorylated (p)-H2AX or p-Chk2 were used to measure the DDR to DSB, while simultaneous measurements of cleaved PARP (c-PARP) and amine aqua viability dye were used to quantify apoptosis and cell death. Chemotherapeutics included Ara-C/Dauno (the two drugs currently used in standard AML induction therapy), Gemtuzumab Ozogamicin (GO), and three other agents currently being evaluated in AML clinical trials [Decitabine (DEC), 5-azacytidine (AZA) and Clofarabine (CLO)]. All drugs were used at clinically relevant doses ranging between Cmax and trough levels as reported in published pharmacokinetic studies (Ara-C, 0.5 μg/mL; Dauno, 100 μg/mL; GO, 1.0 μg/mL; CLO, 0.25 μM; AZA, 2.5 μM; DEC, 0.625 μM). Drug-specific incubation times were chosen to analyze both DDR and apoptosis readouts: Ara-C/Dauno (24 hours), GO, CLO, AZA, DEC (48 hours). While DDR responses were observed for CLO and GO at 24 hours, apoptosis responses were not observed until 48 hours (data not shown). Similarly, apoptosis responses were not observed for DEC until 48 hours and were higher for AZA at 48 hours (data not shown). PI3Kinase/Akt and Raf/Ras pathway activities were assessed using stem cell factor (SCF) induced p-Akt and p-Erk readouts. Data was acquired on an LSRII flow cytometer and leukemic cells were identified by CD45 versus right-angle light-scatter. Metrics for DDR (Log 2Fold) and induced apoptosis have been described previously (Rosen, Putta et al., Distinct patterns of DNA damage response and apoptosis correlate with Jak/Stat and PI3kinase response profiles in human acute myelogenous leukemia, 2010, Journal/PLoS One, 5, 8, e12405). 
     Results 
     Characterization of In Vitro Biological Ara-C/Dauno, GO, and SCF Responses in Primary AML Samples 
     Intermediate risk cytogenetic AML samples from pediatric (n=6; ages 2-17 years; median age 15.7 years) and adult (n=5; ages 33-67 years; median age 51.5 years) patients were first incubated with Ara-C/Dauno (24 h) or GO (48 h) and apoptotic responses were measured using the SCNP assay. As expected, marked heterogeneity was observed among AML samples. However, for a given leukemia sample, highly correlated apoptotic responses (R2: 0.83, p-value &lt;0.0001) were observed between Ara-C/Dauno or GO, suggesting cross-resistance/sensitivity between the two regimens ( FIG. 37 (panel A)). These findings were independent of whether the samples were derived from blood or bone marrow or obtained from adult or pediatric AML patients. 
     An association was observed between in vitro resistance to Ara-C/Dauno and high levels of SCF-induced p-Erk and p-Akt in pediatric BMMC ( FIG. 37 (panel B)) suggesting that Ara-C/Dauno (and GO) resistance may be associated with elevated PI3K and Ras/Raf pathway activity. Also of interest, sample COG-06 was resistant to Ara-C/Dauno and GO, however co-treatment of this sample with GO and multidrug resistance (MDR) inhibitor PSC833 substantially sensitized the leukemic cells to GO-induced apoptosis, suggesting that MDR activity could be responsible for the observed in vitro drug resistance (data not shown). Insufficient numbers of cells in the adult AML samples precluded further characterization of the underlying resistance mechanisms. 
     Characterization of In Vitro Biological Clofarabine, Decitabine, and Azacitidine Responses in Primary Pediatric AML Samples 
     Three of six pediatric samples (COG-06, COG-07 and COG-09) showed levels of induced apoptosis less than 50% after in vitro exposure to Ara-C/Dauno (24 hours) or GO (48 hours). These samples were further examined for DDR and apoptosis responses after 24 hour and 48 hour incubation with other classes of drugs currently in clinical development for AML, specifically CLO, DEC or AZA. As shown in Table 42, heterogeneous DDR and apoptosis drug responses within the different AML samples were observed. Specifically, one sample, COG-06 (MDR+), demonstrated “sensitivity” (herein defined as &gt;50% of cells induced to undergo apoptosis) after exposure to CLO (81%), AZA (77.5%) and DEC (55.8%) (agents which are not MDR substrates) after 48 hours of incubation with those drugs. For this AML sample, a robust DDR to CLO (DNA damaging agent) was also noted ( FIG. 38 (panels A and B)). In contrast, COG-07 was resistant to all three agents (20%, 32%, 29% of cells undergoing apoptosis, respectively) and showed a defective DDR to both Ara-C/Dauno and CLO ( FIGS. 37 (panel B),  38 (panels A and B)), suggesting a general block in the DDR to genotoxins in these leukemic cells. Finally, COG-09 induced a robust DDR to CLO but failed to induce an apoptosis response (13% apoptotic cells) ( FIG. 38 (panels A and B)), similar to results with Ara-C/Dauno ( FIG. 37 (panel B)). Of note, while COG-09 was resistant to DEC (5% apoptotic cells), this sample was sensitive to AZA (57% apoptotic cells) ( FIG. 38 (panel A)). 
                     TABLE 42                  Drug responses with different AML Samples                                     Ara-C                        Dauno   CLO   AZA   DEC                                                 Sample   DDR   Apo   DDR   Apo   DDR   Apo   DDR   Apo               COG-06   −   −   +   +   −   +   −   +       COG-07   −   −   −   −   −   −   −   −       COG-09   +   −   +   −   −   +   −   −                    
For DDR, “+” signifies Log 2Fold &gt;0.5 (in live cPARP− cells). For Apo, “+” signifies induced apoptosis &gt;50%. DDR was assessed with pChk2 for Ara-C/Dauno and pH2AX for CLO, AZA, and DEC. pChk2 and pH2AX are highly correlated (R: 0.8, data not shown). Results shown represent 24 hour treatment with Ara-C/Dauno and 48 hour treatment with CLO, AZA and DEC. Drug-specific timepoints were chosen in order to analyze both DDR and apoptosis readouts.
 
     Treatment of Ara-C/Dauno resistant AML samples with epigenetic modulators identified leukemia that was sensitive (&gt;50% apoptosis) to AZA and resistant to DEC (COG-09), sensitive to both DEC and AZA (COG-06) and resistant to both DEC and AZA (COG-07), suggesting DEC and AZA are not cross-resistant at least in pediatric AML ( FIG. 38 (panels A and C)). While AZA or DEC treatment induced pH2AX, in agreement with previous studies (Palii, Van Emburgh et al., DNA methylation inhibitor 5-Aza-2′-deoxycytidine induces reversible genome-wide DNA damage that is distinctly influenced by DNA methyltransferases 1 and 3B, 2008, Journal/Mol Cell Biol, 28, 2, 752-771; Hollenbach, Nguyen et al., A comparison of azacitidine and decitabine activities in acute myeloid leukemia cell lines, 2010, Journal/PLoS ONE, 5, 2, e9001), pH2AX was not observed in live cPARP-cells prior to induction of apoptosis ( FIG. 38 (panels A and C)). 
     DISCUSSION AND CONCLUSIONS 
     Acute myeloid leukemias (AML) that are non-responsive to induction chemotherapy generally have poor prognosis. Understanding the biological mechanisms of drug resistance or sensitivity specific to each individual AML could inform biologically-based treatment selection in the salvage setting. This study uses SCNP assay, in which cells are perturbed with extracellular modulators (such as cytokines or chemotherapeutic agents) and their response ascertained by multiparametric flow cytometry, as a tool to describe mechanisms of resistance in primary AML samples. Since patient age and cytogenetics are two important predictive factors for response to standard induction therapy, only intermediate risk cytogenetic samples from both pediatric and adult AML patients were included in this study. 
     Our results demonstrate highly correlated apoptotic responses between Ara-C/Dauno or GO, suggesting cross-resistance/sensitivity between the two regimens. Recent clinical trials (SWOG S0106 and MRC 15) have investigated the concurrent use of GO with induction chemotherapy (Ara-C/Dauno based) (Kell, Burnett et al., A feasibility study of simultaneous administration of gemtuzumab ozogamicin with intensive chemotherapy in induction and consolidation in younger patients with acute myeloid leukemia, 2003, Journal/Blood, 102, 13, 4277-4283; Arceci, Sande et al., Safety and efficacy of gemtuzumab ozogamicin in pediatric patients with advanced CD33+ acute myeloid leukemia, 2005, Journal/Blood, 106, 4, 1183-1188). Based on our in vitro observations, we would not expect this combination to act additively/synergistically in the clinic. In agreement with this, both Phase 3 trials failed to show an overall survival benefit from the addition of GO to Ara-C/Dauno regimens (except in the favorable cytogenetic AML subgroup in the MRC study) and the drug was voluntarily removed from the market by the manufacturer (Burnett, Hills et al., Identification of patients with acute myeloblastic leukemia who benefit from the addition of gemtuzumab ozogamicin: results of the MRC AML15 trial, 2011, Journal/J Clin Oncol, 29, 4, 369-377). 
     Of note, a significant association between in vitro resistance to Ara-C/Dauno and high levels of SCF induced p-Erk and p-Akt was observed in pediatric BMMC. PI3K/Akt and Ras/Raf/Erk survival signaling has been shown to play a fundamental role in opposing apoptosis and is associated with clinical resistance to a variety of agents, including those used to induce remission in AML (Martelli, Nyakern et al., Phosphoinositide 3-kinase/Akt signaling pathway and its therapeutical implications for human acute myeloid leukemia, 2006, Journal/Leukemia, 20, 6, 911-928; Rosen, Putta et al., Distinct patterns of DNA damage response and apoptosis correlate with Jak/Stat and PI3kinase response profiles in human acute myelogenous leukemia, 2010, Journal/PLoS One, 5, 8, e12405; Wallin, Guan et al., Nuclear phospho-Akt increase predicts synergy of PI3K inhibition and doxorubicin in breast and ovarian cancer, 2010, Journal/Sci Transl Med, 2, 48, 48ra66) and with inferior survival in AML (Kornblau, Womble et al., Simultaneous activation of multiple signal transduction pathways confers poor prognosis in acute myelogenous leukemia, 2006, Journal/Blood, 108, 7, 2358-2365). Moreover, recent studies (Wallin, Guan et al., Nuclear phospho-Akt increase predicts synergy of PI3K inhibition and doxorubicin in breast and ovarian cancer, 2010, Journal/Sci Transl Med, 2, 48, 48ra66) have demonstrated synergy between PI3K inhibitors and genotoxins in cancer samples with elevated PI3K pathway activity. Our data suggest that Ara-C/Dauno (and GO) resistance may be associated with elevated PI3K and Ras/Raf pathway activity which can make the measurement of the latter a potential (and convenient) predictive biomarker of leukemic cell chemosensitivity to standard cytotoxic induction therapy. 
     DDR and apoptosis responses of leukemic cells following in vitro incubation with CLO, DEC, or AZA (other relevant chemotherapeutics currently in clinical development as anti-leukemic drugs) showed individual AML-specific patterns. This suggests that distinct drug resistance mechanisms fall upstream (defective DDR) and/or downstream (DDR in the absence of apoptosis) in the DNA damage-apoptosis response pathway, or in the more holistic cell survival signaling network, as exemplified by the elevated levels of PI3K pathway activity observed in some of the chemo-refractory samples. Similar results have been previously reported in adult AML in response to etoposide, another DNA damaging agent (Rosen, Putta et al., Distinct patterns of DNA damage response and apoptosis correlate with Jak/Stat and PI3kinase response profiles in human acute myelogenous leukemia, 2010, Journal/PLoS One, 5, 8, e12405). These observations support the need for personalized, biologically-driven combination therapy approaches in AML. 
     DNA damage and apoptosis responses in AML samples also revealed insights into the distinct mechanisms of action of individual drugs. Treatment of Ara-C/Dauno resistant AML samples with epigenetic modulators identified leukemia that was sensitive (&gt;50% apoptosis) to AZA and resistant to DEC (COG-09), sensitive to both DEC and AZA (COG-06) and resistant to both DEC and AZA (COG-07), suggesting DEC and AZA are not cross-resistant in pediatric AML ( FIG. 38 (panels A and C)), a finding which likely reflects the mechanistic differences between these agents (Fabiani, Leone et al., Analysis of genome-wide methylation and gene expression induced by 5-aza-2′-deoxycytidine identifies BCL2L10 as a frequent methylation target in acute myeloid leukemia, 2010, Journal/Leuk Lymphoma, 51, 12, 2275-2284; Hollenbach, Nguyen et al., A comparison of azacitidine and decitabine activities in acute myeloid leukemia cell lines, 2010, Journal/PLoS ONE, 5, 2, e9001; Schnekenburger, Grandjenette et al., Sustained exposure to the DNA demethylating agent, 2′-deoxy-5-azacytidine, leads to apoptotic cell death in chronic myeloid leukemia by promoting differentiation, senescence, and autophagy, 2011, Journal/Biochem Pharmacol, 81, 3, 364-378). Moreover, distinct DDR and apoptosis profiles were observed between different classes of agents. For genotoxins (Ara-C/Dauno, GO, and CLO), induced DNA damage (pH2AX) was observed before apoptosis. In contrast, for epigenetic modifiers (AZA, DEC), DNA damage was observed coincident with apoptosis. While classical genotoxins directly induce DNA damage which, if left unrepaired, leads to apoptosis, epigenetic modifiers likely induce apoptosis through alteration of gene expression profiles (Hollenbach, Nguyen et al., A comparison of azacitidine and decitabine activities in acute myeloid leukemia cell lines, 2010, Journal/PLoS ONE, 5, 2, e9001). The observation that AZA and DEC induced DNA damage only occurred in apoptotic cPARP+ cells, suggests that this apoptotic DNA damage may be caused by apoptotic nucleases (Trisciuoglio and Bianchi, Several nuclear events during apoptosis depend on caspase-3 activation but do not constitute a common pathway, 2009, Journal/PLoS One, 4, 7, e6234; Widlak and Garrard, Roles of the major apoptotic nuclease-DNA fragmentation factor-in biology and disease, 2009, Journal/Cell Mol Life Sci, 66, 2, 263-274). This implies that for epigenetic modifiers, DNA damage may not be a cause of cell death, but rather a consequence. These observations stress the importance of analyzing distinct cellular populations such as cPARP positive (apoptotic) vs. cPARP negative (non-apoptotic) in measuring functional responses and have implications for the design and kinetics of therapy-specific in vitro assays. 
     Taken together, these data provide an initial insight into mechanisms of biological resistance to in vitro Ara-C/Dauno exposure in AML samples and illustrate the ability of SCNP to reveal functional heterogeneity between unique clinical samples. To understand their clinical relevance, ongoing studies are examining these biological DDR and apoptosis signaling profiles in a larger set of leukemic samples, with documented clinical outcomes to standard therapy. We envision a future where in vitro biological profiling of individual tumor biology, including DNA damage/apoptosis responses and PI3K/Akt pathway activity, is used to aid physicians and patients in the selection of salvage chemotherapy for AML. 
     Example 21 
     An example (protocol 2011033) similar to the assay performed in Example 19 was conducted and the results were similar to those obtained in example 19. The use of a model to predict maturity as a way to identify samples as mature or immature was also employed. Samples were assayed in a manner similar to that shown in Example 19. Manual coding was performed on the cell samples prior to unblinding with the expert (operator) blinded to tissue, model predictions and all other clinical information (including FAB). The maturity model showed high accuracy (AUCROC of 0.926, p=4.6×10 −16 , N Immature =98, N Mature =43) in predicting maturing as coded by the expert. 
     Example 22 
     This Example illustrates training and validation for a classifier for predicting response to standard induction therapy in elderly AML patients, using a bivariate SCNP classifier where one node reflects apoptotic response of cells exposed to one or more apoptosis-inducing agents, and the second node reflects change in overall blast cell population, in this case, immature blasts. 
     Single-cell network profiling (SCNP) technology uses multi-parameter flow cytometry to study signaling pathways and networks at the single-cell level. Assaying cells at this level of resolution allows the identification of rare cell populations and reveals differences in the capacity of signaling pathways among cell subtypes, as well as between and within patient samples. The current Example presents the development and validation of a SCNP classifier (DX SCNP ) for the prediction of response to Ara-C-based induction chemotherapy in elderly (&gt;55 year old) patients with newly diagnosed AML. Single-cell network profiling (SCNP) data generated from multi-parametric flow cytometry analysis of bone marrow (BM) and peripheral blood (PB) samples collected from patients &gt;55 years old with non-M3 AML were used to train and validate a diagnostic classifier (DX SCNP ) for predicting response to standard induction chemotherapy (complete response [CR] or CR with incomplete hematologic recovery [CRi] versus resistant disease [RD]). SCNP-evaluable patients from four SWOG AML trials were randomized between Training (N=74 patients with CR, CRi or RD; BM set=43; PB set=57) and Validation Analysis Sets (N=71; BM set=42, PB set=53). Cell survival, differentiation, and apoptosis pathway signaling were used as potential inputs for DX SCNP . Five DX SCNP  classifiers were developed on the SWOG Training set and tested for prediction accuracy in an independent BM verification sample set (N=24) from ECOG AML trials to select the final classifier, which was a significant predictor of CR/CRi (area under the receiver operating characteristic curve AUROC=0.76, p=0.01). The selected classifier was then validated in the SWOG BM Validation Set (AUROC=0.72, p=0.02). Importantly, a classifier developed using only clinical and molecular inputs from the same sample set (DX CLINICAL2 ) lacked prediction accuracy: AUROC=0.61 (p=0.18) in the BM Verification Set and 0.53 (p=0.38) in the BM Validation Set. Notably, the DX SCNP  classifier was still significant in predicting response in the BM Validation Analysis Set after controlling for DX CLINICAL2  (p=0.03), showing that DX SCNP  provides information that is independent from that provided by currently used prognostic markers. Taken together, these data show that the proteomic classifier provides prognostic information relevant to treatment planning beyond genetic mutations and traditional prognostic factors in elderly AML. 
     Materials and Methods 
     Ethics Statement 
     In accordance with the Declaration of Helsinki, all patients provided written informed consent for the collection and use of their samples for research purposes. Institutional Review Board approval was obtained from Independent Review Consulting, Inc. (Approval No. 09068-01) on Aug. 31, 2009. Clinical data were de-identified in compliance with Health Insurance Portability and Accountability Act regulations. 
     Study Inclusion Criteria and Patient Samples 
     The study used cryopreserved pretreatment bone marrow (BM) and peripheral blood (PB) samples collected from two groups of AML patients: patients enrolled in SWOG studies (used in the training and validation efforts) and patients enrolled in ECOG studies (used in the verification analysis). 
     For patients enrolled in SWOG trials, inclusion criteria were age &gt;55 years, diagnosis of non-APL AML, and enrollment in one of four SWOG frontline treatment trials using Ara-C-based induction therapy (SWOG-9031 [12], SWOG-9333 [13] (Ara-C/daunorubicin arm only), S0112 [14] or S0301 [14] (Supplemental Table S1). Eligible patients had two or more vials of a pre-induction sample (BM, PB or both) remaining in the SWOG AML biorepository, received at least one dose of Ara-C and consented for research use of their samples.  FIG. 40  shows the SWOG patient disposition flowchart: of the 536 patients registered on the above mentioned SWOG trials, 266 patients contributed samples (i.e. pretreatment BM and/or PB) to the SCNP assay. 
     For patients enrolled in ECOG trials, inclusion criteria were &gt;60 years of age with diagnosis of non-APL AML enrolled in one of two ECOG treatment protocols using Ara-C-based induction therapy: E3993 [15] and E3999 [16] (Supplemental Table S1). Eligible patients had two or more remaining vials of a pre-induction BM sample stored in the ECOG AML tissue repository, received at least one dose of Ara-C, and consented for research use of their samples.  FIG. 41  shows the ECOG patient disposition flowchart: 50 patients contributed a BM sample to the Verification Set. 
     Induction therapy for all patients consisted of a variation on standard dose cytarabine-based therapy (100-200 mg/m2) for 7 days and daunorubicin 30-45 mg/m2 for 3 days (for details of study designs including sample size, chemotherapies received and response see Supplemental Table S1). 
     For all studies, the following induction-therapy outcomes were defined, based on previously published guidelines [6]: complete response (CR); CR with incomplete peripheral blood count recovery (CRi); resistant disease (RD); and TRM, including fatal induction toxicity, and early death (ED) in the absence of fatal induction toxicity (i.e., treatment response coded as death from any cause by study day 30 or indeterminate due to death during aplasia or within 7 days after induction). The CR rates for the treatment regimens from SWOG and ECOG studies referenced above ranged from 38% to 50% [12], [13], [14], [15], [16]. 
     For all patients cytogenetic risk classification was assigned using NCCN 2013 guideline criteria. Similarly to what is done in clinical practice, patients with unknown cytogenetics risk categories were imputed as intermediate cytogenetics. 
     Study Design 
     SCNP assays for all SWOG patient samples were performed blindly to all clinical data and in a random order as part of a single experiment. Patients with assessable BM and/or PB SCNP results (n=213) were then randomized approximately 1:1 to Training and Validation Sets (see  FIGS. 40 and 42 ). The minimization approach of Pocock and Simon [17] was used to balance disease characteristics and other relevant variables between the Training and Validation Sets. These included: response to induction therapy, sample type(s), cytogenetic risk group, SWOG parent trial treatment arm, and FLT3-ITD mutation in BM and/or PB samples, and extent of proteomic readout availability in BM and/or PB samples (see Supplemental Material, Section 1.3). Within the Training and Validation Sets, only patients having an induction outcome of CR, CRi, or RD were assigned to the Training and Validation Analysis Sets; patients with TRM were excluded from the Analysis Sets since the assay was specifically designed to measure blast chemosensitivity and not comorbidities [9], [18] ( FIG. 40 ). Clinical and molecular variables from 74 patients randomized to the Training Set were used to develop DX CLINICAL1  and DX CLINICAL2 . SCNP data for the BM (n=43) and PB (n=57) Training Analysis Sets were used to develop the SCNP-based predictive models. Since some patients had two SCNP-assessable samples (BM and PB), a partial overlap existed between the patients in the BM and PB Analysis Sets. However, within each Analysis Set, each patient contributed only one sample (i.e., only one tissue type) ( FIG. 42 ). Values of inputs for DX CLINICAL1  and DX CLINICAL2  which were missing (≦6% for any input), were imputed as described in the Supplemental Material Section 1.5. 
     Patient BM samples from ECOG AML trials were assayed separately and were used as an independent BM Verification Set to test multiple candidate classifiers prior to locking the final DX SCNP  classifier for validation ( FIGS. 41 and 42 ). 
     SCNP Assay Terminology and Biological Pathways Evaluated in Training Set 
     For detailed information on assay components and performance parameters please see the MiFlowCyt report provided as part of the Supplemental Material and compiled as per MiFlowCyt guidelines [19]. 
     Based upon relevance to AML pathophysiology, cell surface receptors and signaling pathways involved in cell survival, proliferation, programmed cell death (apoptosis), and the DNA damage response (DDR) were investigated. Apoptotic signaling and DDR pathways were measured after in vitro exposure of AML samples to etoposide or Ara-C ( FIG. 43 ). 
     The term “signaling node” (or simply “node”) refers to a proteomic readout in the presence or absence of a specific modulator at a specific time point after modulation. Modulators included endogenous growth factors (e.g., FLT3 ligand), cytokines (e.g., IL-27) and drugs (cytarabine, daunorubicin, and etoposide). Several metrics (normalized assay readouts, see metrics section and Supplemental Figure S1) were applied to quantify the amplitude of response of each signaling node. 
     SCNP Assay 
     The assay was conducted over a 9 week period with 2 batches of 28 samples tested per week. Cells were incubated in 96-well plates according to a pre-specified node priority to evaluate a total of 9 modulators and 53 signaling nodes (see Supplemental Table S2 and MiFlowCyt Report provided as part of the Supplemental Material) with 100,000 cells per well. Cells were fixed, permeabilized, and incubated with a cocktail of fluorochrome-conjugated antibodies that recognize extracellular lineage markers and intracellular epitopes. To assess cell maturation and viability, anti-CD34, anti-CD45 antibodies and Amine Aqua (AA) stain were included in each well. To assess cell “health” [10], anti-cleaved-PARP antibody (cPARP) was included in every well to allow gating ( FIG. 44 ) on cPARP negative (i.e., non-apoptotic) leukemic blast cells. An example of one SCNP assay “node” is: AML cells were incubated with FLT3 ligand (modulator) for 15 minutes and after fixation and permeabilization were exposed to a cocktail of antibodies against surface linear markers (CD45 and CD34) and against epitope-specific sites for the following proteins: cPARP, p-AKT, p-ERK, p-S6. 
     After completion of the SCNP assay, pre-specified methods were used to determine sample evaluability. The term “SCNP-assessable” refers to samples meeting pre-specified assay inclusion and evaluability criteria. SWOG patients with no SCNP-assessable sample(s) were designated non-evaluable and excluded from analyses (see  FIG. 40 ). Clinical characteristics of the 213 SCNP-evaluable SWOG patients and the 294 SWOG patients who were ineligible for this study (N=241) are compared in Supplemental Table S3. Statistically significant differences in some clinical characteristics including WBC and percent of leukemic blasts in both BM and PB (all higher in the evaluable subset, reflecting the greater availability of repository samples from patients with higher counts) were observed. 
     Data and Software 
     Data were acquired using FACSDiva software (BD Biosciences, San Jose, Calif.) on several Canto II (BD) FACS Canto II flow cytometers. FCS files were gated using WinList (Verity House Software, Topsham, Me.) and all data were stored in a MySQL database for access and querying. For details please refer to the MiFlowCyt Report in the Supplemental Material. 
     Metrics 
     Specific metrics were developed to describe and quantify the functional changes observed using the SCNP assay. Median fluorescence intensity (MFI) was computed from the fluorescence intensity levels of the cells. Equivalent Number of Reference Fluorophores (ERF), a transformed value of the MFI values, was computed using a calibration line determined by fitting observations of a standardized set of 8-peak rainbow calibration particle beads (RCPs) for all fluorescent channels (Spherotech Libertyville, Ill.; Cat. No. RFP-30-5A) to standard values assigned by the manufacturer. ERF was used to standardize, qualify and monitor the instrument during setup, and to calibrate the raw fluorescence intensity readouts on a plate-by-plate basis and to control for instrument variability. ERF values were then used to compute a variety of metrics to measure the biology of functional signaling proteins (Supplemental Figure S1). Additional metrics to measure total phospho-protein levels before and after modulation were computed using ERF value between two wells as listed below. In the metric definitions that follow a=autofluorescence, u=unmodulated, and m=modulated. 
     Basal is defined as: 
       Basal= log _2[ ERF _unmodulated/ ERF _autofluorescence] 
     Log 2Fold Change is defined as: 
         log _2 Fold= log _2[ ERF _modulated/ ERF _unmodulated] 
     Uu is the Mann-Whitney U statistic comparing the intensity values for an antibody in the modulated and unmodulated wells that has been scaled to the unit interval (0.1) for a given cell population for a sample. Measures the proportion of cells that have higher (Uu&gt;0.5) or lower (Uu&lt;0.5) expression of the antibody in the modulated state compared to the unmodulated state. Similar in nature to percentage of cell that have positive (or negative) expression, except that a threshold to determine positivity is not necessary. 
     Ua is the same as the Uu metric except that the auto-fluorescence well is used as the reference instead of the unmodulated well. 
     The percent healthy metric was calculated for each sample by using the autofluorescence well and the c-PARP stained well: 
     P_ĥIntact: Percentage of leukemic blast cells that is negative for cPARP expression. The 98th percentile value for autofluorescence was used to determine the positive-negative split point. 
     Controls and Reproducibility 
     Standard instrument controls (RCP beads—see section above and MiFlowCyt Report in supplemental material) and cell line controls (see below) enabled the assessment of technical variability at the modulation, fixation, staining, and acquisition steps in the laboratory work flow thus allowing for the generation of reproducible results across operators, plates and time. These controls are essential in clinically applicable assays. Overall assay performance was monitored by running GDM1 and RS4; 11 cell lines on every plate. Original cell lines were obtained from American Type Culture Collection (ATCC; Manassas, Va.). A single batch of these cell lines were expanded in culture, cryopreserved, quality control tested and released following performance verification according to approved SOPs and appropriate release specifications. Intra- and inter-cytometer variance and longitudinal consistency of instrument performance were monitored by including a single lot of 8-peak RCPs on each plate across the entire experiment. Additionally, all cytometers were qualified each day before use according to the manufacturer&#39;s suggested quality control program as well as a more stringent internally developed quality control program documented in approved SOPs and performance specifications. Cytometers performing outside established performance specifications were taken off-line, corrective actions taken and documented and the instrument then verified prior to bringing back on-line for use. With these controls in place the majority (28/44) of the CVs were less than 5% and most of them (42/44) were less than 10% as expected across all days and batches for the study (MiFlowCyt Report in supplemental material). 
     Classifier Development 
     During the training phase, clinical data for the Training Set were unblinded and used to develop three distinct classifiers, DX CLINICAL1 , DX CLINICAL2 , and DX SCNP , using different sets of inputs to predict CR/CRi vs. RD. 
     DX CLINICAL1 : Inputs included clinical factors available at diagnosis [i.e. age, BM blast percentage, white blood cell count, peripheral blast percentage, neutrophil and monocyte counts (percent and absolute), hemoglobin, platelet count, performance status (0-1 vs. 2-3), FAB class (M0/M1/M2/M7 vs. other), and AML onset (de novo vs. secondary)] for the 74 patients from SWOG trials randomized to the Training Set. 
     DX CLINICAL2 : In addition to the clinical factors used for DX CLINICAL1 , inputs for DX CLINICAL2  included cytogenetic risk group, percentage of CD34+ cells, and presence of genetic markers for FLT3-ITD (as a continuous variable and as binary) and NPM1 mutations. Percentage of CD34+ cells was calculated from phenotyping well during the SCNP assay because this information was not available for the SWOG samples from the clinical site. 
     DX SCNP : Inputs included cell survival, growth, differentiation, and cell-death pathways with multiple modulated proteomic readouts (e.g., IL-27→p-STAT1/3/5; Ara-C/daunorubicin→cPARP for a total of 53 signaling nodes ( FIG. 43 ). Since only a subset of the overall available samples were “paired” (i.e. BM and PB samples collected from the same patient) and based on our previous published data showing that the correlation of signaling nodes in paired PB and BM samples, although high, was not perfect in particular in AML secondary to MDS [20], the decision was made to perform DX SCNP  modeling separately in the BM (n=43) and PB (n=57) Training Analysis Sets. Logistic regression models were investigated as predictors of response. These models were fit by LASSO using the R Penalized Package [21], and their performance was measured by the AUROC, using out-of-bag (OOB) estimation. Model outputs for all classifiers were continuous scores, where higher scores indicated a greater probability of response (CR/CRi) to Ara-C-based induction chemotherapy. 
       FIG. 42  summarizes the workflow followed from model training to validation for DX SCNP . Briefly, an initial subset of nodes was first identified in each Training Set by examining: 1) node signaling differences between CR/CRi and RD, 2) Random Forest [22] node importance for CR/CRi vs. RD using all nodes, and 3) non-zero node coefficients by Penalized Logistic Regression [23], [24], [25], [26], [27] for CR/CRi vs. RD using all nodes. 
     To find combinations of nodes that were better predictors of CR/CRi vs. RD compared to individual nodes, models based on 2-to-4 node combinations from the initial node subset were developed using logistic regression. The adjusted AUROC for each of the models was calculated [28]. Bootstrap re-sampling (n=500) was used to adjust the AUROC for optimism. The models were then ranked by their adjusted AUROC and several related high-ranking models were investigated further. The lead candidates were selected based on several criteria, including biological pathway relevance, range of node signaling and experience from previous studies [7]. 
     Five candidate DX SCNP  classifiers (TABLE 43), each containing apoptosis pathway nodes alone or in combination with signaling nodes, were generated using the PB Training Analysis Set. The AUROCs for these models, when applied to the BM Training Analysis Set, were all greater than 0.74, justifying their use for both tissue types. The five candidate models were then locked for evaluation in the Verification Analysis Set (BM samples from ECOG trials), and the resulting data were used to select a single DXSCNP classifier to refine and lock for validation (TABLE 43). 
     
       
         
           
               
             
               
                 TABLE 43 
               
             
            
               
                   
               
               
                 Candidate Models 
               
            
           
           
               
               
               
            
               
                   
                 AUC (Out of 
                 AUC in BM 
               
               
                   
                 Bag) in Training  
                 Verification 
               
               
                   
                 Analysis Sets 
                 Analysis Set 
               
            
           
           
               
               
               
               
            
               
                 Model Description 
                 PB 
                 BM 
                 BM* 
               
               
                   
               
               
                 Model 1 
                 0.91 
                 0.78 
                 0.67 (p = 0.119) 
               
               
                 AraC + D→cPARP | U u   
                   
                   
                   
               
               
                 FLT3L→pAkt | log 2 (Fold) 
                   
                   
                   
               
               
                 Model 2: 
                 0.82 
                 0.75 
                 0.65 (p = 0.153) 
               
               
                 AraC + D→cPARP | U u   
                   
                   
                   
               
               
                 PMA→pCREB | log 2 (Fold) 
                   
                   
                   
               
               
                 Model 3: 
                 0.91 
                 0.81 
                 0.72 (p = 0.047) 
               
               
                 AraC + D→cPARP U u   
                   
                   
                   
               
               
                 AraC→CD34 | U u   
                   
                   
                   
               
               
                 FLT3L→pAkt | log 2 (Fold) 
                   
                   
                   
               
               
                 Model 4: 
                 0.86 
                 0.74 
                 0.67 (p = 0.084) 
               
               
                 AraC + D→cPARP | U u   
                   
                   
                   
               
               
                 FLT3L→pAkt | log 2 (Fold) 
                   
                   
                   
               
               
                 Basal→pAkt | U a   
                   
                   
                   
               
               
                 Model 5: 
                 0.91 
                 0.8 
                 0.76 (p = 0.017) 
               
               
                 AraC + D→cPARP | U u   
                   
                   
                   
               
               
                 AraC→CD34 | U u   
               
               
                   
               
               
                 *The number of patients who achieved CR/CRi varied between 8 and 12 for each of the classifiers depending on the availability of node-metric data of all the predictor variables involved in a classifier. The number of RDs was 12 for all models. 
               
            
           
         
       
     
     The final selected Elderly AML Induction Response classifier was locked (Table 44) and classifier scores were calculated for each patient in the BM Validation Analysis Set (n=42) and PB Validation Analysis Set (n=53) independently. 
     A similar procedure was followed to build DX CLINICAL 1 and DX CLINICAL2 . However, since a majority of inputs for these predictors are not tissue-specific, separate models for BM and PB were not considered. Data from all patients in the Training Analysis Set (N=74) were input to penalized regression methods to identify variables that are likely to be predictive of response. In the case for DX CLINICAL1 , none of the input variables were chosen by penalized regression (i.e. all coefficients were shrunk to zero), indicating that a classifier cannot be constructed with these input variables. For DX CLINICAL2 , performance characteristics were estimated using bootstrapping in the Training Analysis Set in the same manner as done for DX SCNP . DX CLINICAL2  was applied independently to the BM and PB Validation Analysis Sets, as was done for DX SCNP . 
     Statistical Analysis 
     Patient and disease characteristics were summarized by standard descriptive techniques, and compared between subsets using Fisher&#39;s exact test, Pearson&#39;s chi-squared test of independence, logrank, and the Mann-Whitney test. 
     Sample Size 
     Estimates of AUROC, after adjusting for optimism, from the Training Analysis Set for the lead DX SCNP  candidates were between 0.74 and 0.91 (TABLE 43). Sample size estimates for the test of AUROC against the value of 0.5 under null hypothesis were performed for true AUROC in the range of 0.75 and 0.80. The power was expected to exceed 80% for a Validation Analysis Set of approximately 50 subjects with the same induction response rate as the subjects in the Training Analysis Set. 
     Measures of Predictive Performance 
     Since the AUROC, estimated empirically using the trapezoidal method, is equivalent to the Mann-Whitney U-statistic (AUROC=U/(n1+n2) [27]), the null hypothesis of no association (HO: U=0) tested against the one sided alternative (H1: U&gt;0), is equivalent to a one-sided exact test of HO: AUROC=0.5 versus H1: AUROC&gt;0.5. In addition to the p-value from the exact test for the Mann Whitney U value, the 95% confidence interval for the AUROC estimate was calculated using the bias-corrected-and-accelerated (BCa) bootstrap method [29]. 
     Response Prediction Using Cell Death as Measured by Amine Aqua 
     Amine aqua stain was included in every well to allow exclusion by gating of non-viable cells. To assess whether a measurement of cell viability alone after 24 hour incubation with AraC/daunorubicin could accurately predict induction outcome, a decrease in the viability of cells treated with Ara-C/Daunorubicin for 24 hours relative to untreated cells (at 24 hours but otherwise processed similarly) was used for this purpose. The Uu metric was used to measure this change in viability and then used to assess an association with response to therapy. 
     Results 
     Patient Characteristics 
     As shown in  FIG. 40 , assessable SCNP results were obtained for at least one specimen for 213 SWOG patients, and for 24 patients in the ECOG Verification Set ( FIG. 41 ). Characteristics of patients in the BM Training, Verification and Validation Analysis Sets and the of the PB Training and Validation Analysis Sets are shown in Tables 44 and 45, respectively. No statistically significant differences in clinical characteristics were observed between the Training and Validation Sets, or between SCNP-evaluable and -nonevaluable patients (TABLES 46 and 47 for SWOG and ECOG patients, respectively). Of note, although not statistically significant, the BM Training Analysis Set had a lower percentage of patients with secondary AML (12%) compared with the BM Validation Analysis Set (19%) (secondary AML was not a stratification factor in the sample randomization) and the BM Verification Analysis Set (29%). By contrast, comparison between the 213 SCNP-evaluable SWOG patients and the 294 other potential SWOG patients (53 selected for the study but with no SCNP-assessable results, 241 not selected primarily due to fewer than 2 vials available from the repository) showed that SCNP-evaluable patients had significantly higher counts (WBC, BM and PB blast percentages), fewer patients from SWOG-9031 (earliest of the four SWOG trials), and fewer patients with monosomy 5 or 7 (Supplemental Table S3). However, treatment outcomes did not differ significantly between the two groups. 
     
       
         
           
               
             
               
                 TABLE 44 
               
             
            
               
                   
               
               
                 Patient/Disease Characteristics of the BM Training,  
               
               
                 Verification and Validation Analysis Sets 
               
            
           
           
               
               
               
               
               
               
            
               
                   
                   
                 BM  
                 BM 
                   
                 BM  
               
               
                 Patient/ 
                   
                 Training  
                 Validation 
                   
                 Verification 
               
               
                 Disease 
                   
                 Analysis  
                 Analysis  
                   
                 Analysis  
               
               
                 Charac- 
                   
                 Set  
                 Set 
                   
                 Set 
               
               
                 teristics 
                 Sub-Groups 
                 (n = 43) 
                 (n = 42) 
                 P  b   
                 (n = 24) 
               
               
                   
               
            
           
           
               
               
               
               
               
               
            
               
                 Response to 
                 RD 
                 12 
                 10 
                 0.92 
                 12 
               
               
                 induction 
                 CR/CRi  
                 19 
                 20 
                   
                 12 
               
               
                 therapy  a   
                 without 
                   
                   
                   
                   
               
               
                   
                 CCR1 
                   
                   
                   
                   
               
               
                   
                 CCR1 
                 12 
                 12 
                   
                 0 
               
               
                 Age (Years) 
                 (Min, Max) 
                 (56.8,  
                 (58.0,  
                 0.98 
                 (57, 80) 
               
               
                   
                   
                 83.9) 
                 82.0) 
                   
                   
               
               
                   
                 Median 
                 68.2 
                 69.0 
                   
                 69 
               
               
                 Cytogenetic 
                 Better 
                 4 
                 2 
                 0.86 
                 0 
               
               
                 risk group 
                 Intermediate  c   
                 26 
                 25 
                   
                 10 
               
               
                   
                 Poor 
                 6 
                 8 
                   
                 5 
               
               
                   
                 Missing 
                 7 
                 7 
                   
                 9 
               
               
                 FLT3 ITD 
                 Mutant 
                 8 
                 10 
                 0.60 
                 4 
               
               
                   
                 Wildtype 
                 35 
                 32 
                   
                 17 
               
               
                   
                 Unknown 
                 0 
                 0 
                   
                 3 
               
               
                 Sex 
                 F 
                 16 
                 15 
                 1.00 
                 9 
               
               
                   
                 M 
                 27 
                 27 
                   
                 15 
               
               
                 AML onset 
                 De novo 
                 38 
                 34 
                 0.38 
                 17 
               
               
                   
                 Secondary 
                 5 
                 8 
                   
                 7 
               
               
                 WBC  
                 (Min, Max) 
                 (1.3,  
                 (1.4,  
                 0.62 
                 (1.6,  
               
               
                 (10 9 /L) 
                   
                 263.0) 
                 274.0) 
                   
                 120.2) 
               
               
                   
                 Median 
                 33.2 
                 19.1 
                   
                 28.6 
               
               
                 Percent  
                 (Min, Max) 
                 (26.0,  
                 (31.8,  
                 0.077 
                 (29.8,  
               
               
                 Health 
                   
                 87.2) 
                 86.3) 
                   
                 79.76) 
               
               
                 at 15 mins 
                 Median 
                 52.2 
                 60.0 
                   
                 50.4 
               
               
                   
               
               
                   a  CR = complete response; CRi = complete response with incomplete peripheral blood recovery; CCR1 = CR/CRi with duration &gt;1 yr; RD = resistant disease. 
               
               
                   b  P-value for comparison of BM Training and BM Validation Analysis Sets. 
               
               
                   c  Includes patients with known karyotype of indeterminate risk classification. 
               
            
           
         
       
     
     
       
         
           
               
             
               
                 TABLE 45 
               
             
            
               
                   
               
               
                 Patient/Clinical Characteristics of the PB  
               
               
                 Training and Validation Analysis Sets 
               
            
           
           
               
               
               
               
               
            
               
                   
                   
                 PB  
                 PB 
                   
               
               
                   
                   
                 Training 
                 Validation 
                   
               
               
                   
                   
                 Analysis  
                 Analysis  
                   
               
               
                 Patient/Disease 
                 Sub- 
                 Set 
                 Set  
                   
               
               
                 Characteristics 
                 Groups 
                 (n = 57) 
                 (n = 53) 
                 P 
               
               
                   
               
            
           
           
               
               
               
               
               
            
               
                 Response to 
                 RD 
                 14 
                 10 
                 0.87 
               
               
                 induction 
                 CR/CRi 
                 29 
                 29 
                   
               
               
                 therapy 
                 without 
                   
                   
                   
               
               
                   
                 CCR1 
                   
                   
                   
               
               
                   
                 CCR1 
                 14 
                 14 
                   
               
               
                 Age (Years) 
                 (Min, Max) 
                 (56.8, 83.9) 
                 (59.0, 82.0) 
                 0.17 
               
               
                   
                 medium 
                 68.3 
                 66 
                   
               
               
                 Cytogenetic 
                 Better 
                 7 
                 6 
                 0.99 
               
               
                 risk group 
                 Intermediate 
                 31 
                 30 
                   
               
               
                   
                 Poor 
                 8 
                 8 
                   
               
               
                   
                 Missing 
                 11 
                 9 
                   
               
               
                 FLT3 ITD 
                 Mutant 
                 16 
                 17 
                 0.68 
               
               
                   
                 Wildtype 
                 41 
                 36 
                   
               
               
                 Sex 
                 F 
                 33 
                 20 
                 0.038 
               
               
                   
                 M 
                 24 
                 33 
                   
               
               
                 AML onset 
                 De novo 
                 52 
                 43 
                 0.17 
               
               
                   
                 Secondary 
                 5 
                 10 
                   
               
               
                 WBC (10 9 /L) 
                 (Min, Max) 
                 (2.2, 298.0) 
                 (4.7, 274) 
                 0.28 
               
               
                   
                 medium 
                 26.7 
                 21.9 
                   
               
               
                 Percent Health 
                 (Min, Max) 
                 (27.9, 83.9) 
                 (28.7, 83.1) 
                 0.83 
               
               
                 at 15 mins 
                 medium 
                 60.6 
                 59.3 
                   
               
               
                   
               
            
           
         
       
     
     
       
         
           
               
             
               
                 TABLE 46 
               
             
            
               
                   
               
               
                 Baseline Characteristics for SWOG Patients: SCNP-Evaluable vs. SCNP-Nonevaluable 
               
            
           
           
               
               
               
               
               
               
            
               
                 Patient/Disease 
                   
                 SCNP- 
                 SCNP- 
                   
                   
               
               
                 Characteristics 
                   
                 Evaluable 
                 Nonevaluable 
                   
                 Total 
               
               
                 (SWOG) 
                 Sub-Groups 
                 (n = 213) 
                 (n = 53) 
                 P 
                 (n = 266) 
               
               
                   
               
            
           
           
               
               
               
               
               
               
            
               
                 Response to 
                 RD 
                 39 
                 7 
                 0.64 
                 46 
               
               
                 induction 
                 CR/CRi without CCR1 
                 67 
                 18 
                   
                 85 
               
               
                 therapy 
                 CCR1 
                 39 
                 13 
                   
                 52 
               
               
                   
                 Fatal Induction 
                 68 
                 15 
                   
                 83 
               
               
                   
                 Toxicity 
                   
                   
                   
                   
               
               
                   
                 or Early Death 
                   
                   
                   
                   
               
               
                 Age (Years) 
                 (Min, Max) 
                 (57, 88) 
                 (56, 81) 
                 0.71 
                 (56, 88) 
               
               
                   
                 Median 
                 68 
                 70 
                   
                 68 
               
               
                 Cytogenetic 
                 Better 
                 16 
                 1 
                   
                 17 
               
               
                 risk group 
                 Intermediate 
                 121 
                 30 
                 0.31 
                 151 
               
               
                   
                 Poor 
                 34 
                 7 
                   
                 41 
               
               
                   
                 Unknown 
                 42 
                 15 
                   
                 57 
               
               
                 Sex 
                 F 
                 94 
                 23 
                 1.00 
                 117 
               
               
                   
                 M 
                 119 
                 30 
                   
                 149 
               
               
                 AML onset 
                 De Novo 
                 162 
                 45 
                 0.20 
                 207 
               
               
                   
                 Secondary 
                 51 
                 8 
                   
                 59 
               
               
                   
                 Unknown 
                 0 
                 0 
                   
                 0 
               
               
                 WBC 
                 (Min, Max) 
                 (0.7, 298.0) 
                 (0.8, 243.0) 
                 0.09 
                 (0.7, 298.0) 
               
               
                 (10 9 /L) 
                 Median 
                 22.0 
                 41.1 
                   
                 24.9 
               
               
                 Overall 
                 (Min, Max) 
                 (1, 4866) 
                 (1, 3799) 
                 0.39 
                 (1, 4866) 
               
               
                 Survival (days) 
                 Median 
                 217 
                 246 
                   
                 225 
               
               
                   
               
            
           
         
       
     
     
       
         
           
               
             
               
                 TABLE 47 
               
             
            
               
                   
               
               
                 Baseline Characteristics for ECOG Patients:  
               
               
                 SCNP-Evaluable vs. SCNP-Nonevaluable 
               
            
           
           
               
               
               
               
               
               
            
               
                 Patient/ 
                   
                   
                   
                   
                   
               
               
                 Disease 
                   
                   
                 SCNP- 
                   
                   
               
               
                 Charac- 
                   
                 SCNP- 
                 Non- 
                   
                   
               
               
                 teristics 
                 Sub- 
                 Evaluable  
                 evaluable 
                   
                 Total 
               
               
                 (ECOG) 
                 Groups 
                 (n = 24) 
                 (n = 26) 
                 P 
                 (n = 50) 
               
               
                   
               
            
           
           
               
               
               
               
               
               
            
               
                 Response  
                 CR/CRi 
                 12 
                 14 
                 0.01 
                 26 
               
               
                 to  
                 Fatal  
                 0 
                 6 
                   
                 6 
               
               
                 induction 
                 Induction 
                   
                   
                   
                   
               
               
                 therapy 
                 Toxicity  
                   
                   
                   
                   
               
               
                   
                 or Early 
                   
                   
                   
                   
               
               
                   
                 Death 
                   
                   
                   
                   
               
               
                   
                 RD 
                 12 
                 6 
                   
                 18 
               
               
                 Age  
                 (Min, Max) 
                 (57, 80) 
                 (61, 76) 
                 0.32 
                 (57, 80) 
               
               
                 (Years) 
                 Median 
                 69 
                 68 
                   
                 68 
               
               
                 Cyto- 
                 Intermediate 
                 10 
                 13 
                 0.81 
                 23 
               
               
                 genetics 
                 Poor 
                 5 
                 4 
                   
                 9 
               
               
                 Risk  
                 Unknown 
                 9 
                 9 
                   
                 18 
               
               
                 Group 
                   
                   
                   
                   
                   
               
               
                 Sex 
                 F 
                 9 
                 15 
                 0.17 
                 24 
               
               
                   
                 M 
                 15 
                 11 
                   
                 26 
               
               
                 AML  
                 De Novo 
                 17 
                 18 
                 1.00 
                 35 
               
               
                 Onset 
                 Secondary 
                 7 
                 7 
                   
                 14 
               
               
                   
                 Unknown 
                 0 
                 1 
                   
                 1 
               
               
                 Pre- 
                 (Min, Max) 
                 (1.6, 120.2) 
                 (2.7, 107.0) 
                 0.36 
                 (1.6, 120.2) 
               
               
                 Induction 
                 Median 
                 28.6 
                 46.5 
                   
                 33.9 
               
               
                 WBC  
                   
                   
                   
                   
                   
               
               
                 (10 9 /L) 
                   
                   
                   
                   
                   
               
               
                 Overall  
                 (Min, Max) 
                 (39, 2227) 
                 (2, 1825) 
                 0.52 
                 (2, 2227) 
               
               
                 Survival 
                 Median 
                 231.5 
                 223 
                   
                 227 
               
               
                 (days) 
               
               
                   
               
            
           
         
       
     
     Model Building 
     For the 74 SWOG patients randomized to the Training Analysis Set, model building based on clinical prognostic factors universally known at the time of diagnosis (DX CLINICAL1 ) was attempted but no significant predictive model could be built and therefore, no DX CLINICAL1  model was locked for validation. By contrast, using as inputs of both clinical prognostic factors (e.g. age, white blood cell count, blast percentage, etc.) and cytogenetic and molecular markers the predictive model DX CLINICAL2  achieved an out-of-bag estimated AUROC of 0.63 (see also section 1.6 of Supplemental Materials). 
     For DX SCNP  predictive models, the functional measurement of induced apoptosis at 24 hours (Ara-C+Daunorubicin-induced c-PARP readout) was featured in all 5 models selected for verification based on performance indicating that the measurement of the change in the intra-cellular levels of c-PARP in the total blast population (after excluding Amina Aqua positive cells (i.e. necrotic cells) is a robust indicator of in vivo response to therapy (TABLE 43). The prediction accuracy, measured as AUROC, for these models (which were chosen based on modeling on PB training samples) when applied to the BM Training Analysis Set was similar to prediction accuracy for the classifier trained using BM training analysis set, justifying pursuing a single classifier for validation on both tissue types (TABLE 43). Thus, these 5 models were applied to the BM Verification Analysis Set and a final selected model was refined further using the BM and PB Training Analysis Set to create the final DX SCNP  classifier (Table 48) which was a logistic regression model with two nodes including Ara-C+Daunorubicin-induced c-PARP readout and CD34+Uu. The first node (Ara-C+Daunorubicin-induced c-PARP readout) is a measure of apoptosis induced by the drug treatment among blast cells that have not yet undergone necrosis. The second node, although not directly a measure of apoptosis, measures the remaining fraction of the CD34+ cell subset in the blast population after in vitro exposure to AraC+Daunorubicin (TABLE 48). The optimism-adjusted estimate of the AUROC for this predictor was 0.81 in the BM Training Analysis Set and 0.88 in the PB Training Analysis Set. This locked SCNP classifier, with all parameters fixed, was then applied to the BM Verification Analysis Set to estimate its true performance in an independent data set with resulting AUROC of 0.76, p=0.01, 95% CI=(0.52, 0.91). 
     
       
         
           
               
             
               
                 TABLE 48 
               
               
                   
               
               
                 Locked DX SCNP  Classifier Inputs 
               
               
                   
               
             
            
               
                 SCNP Continuous Score =  
               
               
                 e χ     ′     {circumflex over (β)} /[1 + e χ     ′     {circumflex over (β)} ], 
               
               
                 where χ′ is the vector of node- 
               
               
                 metric values and {circumflex over (β)} is the vector of regression coefficients 
               
            
           
           
               
               
            
               
                 Component 
                 Coefficient 
               
               
                   
               
               
                 Intercept 
                 −1.26004 
               
               
                 C 1   
                 95.60133 
               
               
                 C 2   
                 34.94358 
               
               
                   
               
            
           
           
               
            
               
                 Where 
               
               
                 C 1  = (N 1  − 0.5) 2  if N 1  &gt; 0.5 else C 1  = 0.0 
               
               
                 C 2  = (0.5 − N 2 ) 2  if N 2  &lt; 0.5 else C 2  = 0.0 
               
               
                   
               
            
           
           
               
               
               
               
               
            
               
                 Node- 
                   
                   
                   
                   
               
               
                 metric 
                 Modulator 
                 Time 
                 Antibody 
                 Metric 
               
               
                   
               
               
                 N 1   
                 AraC + Dauno 
                 24 Hours 
                 cPARP 
                 U u   
               
               
                 N 2   
                 AraC + Dauno 
                 24 Hours 
                 CD34 
                 U u   
               
               
                   
               
            
           
         
       
     
     Classifier Performance: BM Validation Analysis Set 
     The DX SCNP  classifier was validated as a predictor of CR/CRi in the BM Validation Analysis Set, with AUROC of 0.72, p=0.02, 95% CI=(0.51, 0.87). In contrast, the DX CLINICAL2  classifier did not show a significant association with response to induction therapy in either the BM Verification Analysis Set (AUROC=0.61, p=0.18) or the BM Validation Analysis Set (AUROC=0.53, p=0.38). Furthermore, analysis was conducted to assess if DX SCNP  provided information for prediction of response that is independent of the DX CLINICAL2 . The predictions from DX CLINICAL2  and DX SCNP  were both included (i.e., controlling for each other) in a combined logistic regression model for response. If predictions from DX SCNP  are redundant to those from DX CLINICAL2 , a non-significant p-value is expected for the coefficient of DX SCNP  in the combined model. However, the SCNP classifier was still significant in predicting response in the BM Validation Analysis Set (p-value for DX SCNP  when controlling for DX CLINICAL2 =0.03) from this analysis, showing that DX SCNP  may provide information that is independent from that provided by currently used prognostic markers. While the small sample sizes do not permit definitive comparisons of classifier accuracy between clinical subsets, the accuracy of predictions from DX SCNP  in BM sample subsets defined by several clinical characteristics are shown in  FIG. 45 . 
     Classifier Performance: PB Validation Analysis Set 
     When the DX SCNP  classifier was applied to the PB Validation Analysis Set it did not accurately predict induction response (AUROC=0.53, p=0.39). A pre-specified subgroup analysis was performed for those with de novo AML vs. secondary AML at diagnosis since these subtypes have marked differences in clinical outcome [12], [13], [14], [15], [16] and data on a limited number of samples had previously shown that PB AML blasts in secondary AML have different signaling profiles than BM blasts [20]. In the de novo subgroup, DX SCNP  was a significant predictor of induction response in both PB and BM samples (TABLE 49). Further, among patients with de novo AML having both BM and PB samples, the values of DX SCNP  were correlated (Pearson&#39;s R=0.7) and had similar predictive value for the two sample types (AUROC=0.71, p=0.044, 95% CI=(0.50, 0.88) for the BM samples and AUROC=0.79, p=0.02, CI=(0.62-0.92) for PB samples). Only three patients with secondary AML had paired PB and BM, precluding any useful analysis of concordance between the tissue types in this subgroup. 
     
       
         
           
               
             
               
                 TABLE 49 
               
             
            
               
                   
               
               
                 Prediction accuracy of DX SCNP  in BM and PB  
               
               
                 Validation Analysis subsets defined by AML  
               
               
                 Type (De Novo vs. Secondary) and availability  
               
               
                 of samples for both tissue types. 
               
            
           
           
               
               
               
               
            
               
                 Sample Set 
                 n (CR) 
                 n (RD) 
                 AUROC (95% CI) 
               
               
                   
               
            
           
           
               
               
               
               
            
               
                 BM 
                 32 
                 10 
                 0.72 (0.53-0.91) 
               
               
                 PB 
                 43 
                 10 
                 0.53 (0.31-0.75) 
               
               
                 De Novo BM 
                 27 
                 7 
                 0.71 (0.48-0.95) 
               
               
                 De Novo PB 
                 38 
                 5 
                 0.79 (0.64-0.95) 
               
               
                 Paired BM 
                 19 
                 3 
                 0.74 (0.53-0.95) 
               
               
                 Paired PB 
                 19 
                 3 
                 0.79 (0.60-0.98) 
               
               
                   
               
            
           
         
       
     
     Response Prediction Using Amine Aqua 
     Measurement of the overall apoptotic capacity of single blasts was found to be a major component of all five candidate classifiers and was present in the final locked classifier. To determine whether a simple measure of cell viability using an exclusion dye such as amine aqua after incubation of the AML samples with Ara-C/daunorubicin for 24 hours could accurately predict response to induction therapy change in levels of in vitro cell death as measured by Uu metric for amina aqua was tested for association with clinical response. Results from this exercise showed that a simple measure of induced cell death at 24 hrs lacked the resolution to predict response to induction therapy (AUROC=0.53, p=0.37). 
     DISCUSSION 
     In this Example, quantitative measurement of intracellular signaling pathways in leukemic blasts was used to develop a predictor of response to induction therapy in elderly AML patients (defined in this study as &gt;55 years old). In the patients studied, this predictor&#39;s association with response was independent from that of currently used clinical and molecular variables. The process of classifier development was rigorous and followed the step-wise approach recommended by regulatory bodies consisting of a Training phase, followed by a Verification and a Validation phases in independent sample sets. 
     Traditionally, age, WBC count at diagnosis [31] and cytogenetics (the latter not always available at diagnosis, particularly at community and non-academic treatment settings [32], are the primary prognostic factors for induction treatment response in AML. Genetic factors such as the presence of FLT3 ITD, CEBPα and NPM1 mutations, which have been incorporated into NCCN guidelines, provide additional prognostic information mostly useful for post-induction treatment planning (i.e. consolidation therapy). More recently, predictive models, such as a web-based application that uses standard clinical and laboratory values (e.g., body temperature, hemoglobin, age at diagnosis, platelets, de novo vs. secondary AML) and cytogenetic and molecular risk factors to generate an overall prognostic score, have been shown to have a significant association with induction response [5], [33]. 
     In the current study the performance of an SCNP-based classifier was assessed in parallel against intra-study developed models which used only clinical (DX CLINICAL1 ) or both clinical and molecular parameters (DX CLINICAL2 ) as classifier inputs. The study design allowed for a descriptive comparison in the same patient population of the different classifiers&#39; performance. After controlling for clinical and genetic variables, the results supported the independence of the prognostic information provided by the SCNP-based classifier from that of traditional clinical and molecular markers [10]. 
     Unfortunately, some of the inputs required to perform the risk score developed by Krug and colleagues (e.g. body temperature) were not available in our data set making it impossible to compare results from the web-based predictor of induction response [5] to the DX SCNP  classifier in our study. Thus, these inputs can serve in some embodiments as additional inputs into the decision as to whether or not to treat with induction therapy. 
     Overall, our findings confirm the value of the SCNP-assay classifier, which can assess the functional effects of downstream multiple genetic and epigenetic molecular alterations. 
     Although the breadth of biology investigated in the training phase of the study included many signaling nodes in multiple pathways believed to be important in the leukemogenesis process and response to chemotherapy (e.g. cell survival, proliferation, DNA damage response, apoptosis pathways), the final locked and validated DX SCNP  classifier incorporated just two signaling nodes that assessed the functional capacity of the intracellular apoptosis pathway in the total blasts and the proportional reduction of CD34+ cells upon treatment in response to in vitro treatment with AraC and Daunorubicin). Of note, the cell-signaling based classifier developed in a pediatric AML population [9] included as input three signaling nodes measuring functional apoptosis, PI3 kinase, and proliferation pathways (i.e. etoposide induced c-PARP, FLT3L-induced p-S6, and Thapsigargin induced p-Erk). The presence of functional apoptosis in both the elderly and pediatric AML classifier is consistent from a biologic point of view, considering that both classifiers were trained to predict remission induction, as defined by a reduction of BM AML blasts to less than 5%. However, it is surprising that a classifier in the elderly AML may be constructed without the other two pathways used in the pediatric AML classifier. Furthermore, it is important to note that a simple determination of cell death using amine aqua after incubation in vitro with chemotherapy agents did not correlate with response to induction chemotherapy (AUROC=0.53, p=0.37). The SCNP functional readout of apoptosis, in which dead cells are excluded by gating out cPARP positive (i.e., apoptotic) leukemic blast cells before proceeding to analysis seems to better capture the ultimate results of positive and negative signals determining intrinsic leukemic cell survival capacity. In addition, the presence of PI3K and MAPK pathways read outs as input in the pediatric classifier indicates that differential biology might be at the basis of AML primary chemotherapy resistance in the two age groups (thus needing different therapeutic approaches to overcome resistance). 
     Several methodological considerations and limitations need to be considered in interpreting these results. First, this study used cryopreserved samples (prospectively collected during the clinical trials) from biorepositories, rather than fresh samples. While this approach is efficient since it allows for batch analysis of large numbers of samples for which clinical annotations have already been collected, it raises concerns about the applicability of results to clinical settings (in which fresh samples will be used); and about the potential to introduce patient selection bias in the analysis, which could limit the generalizability of the classifier to different patient populations. 
     Previous studies have shown high correlation between SCNP readouts in paired fresh and cryopreserved aliquots of the same AML samples [34], suggesting it is likely that the SCNP-based classifier will have the same accuracy and reproducibility when applied to fresh samples [9], [34]. In addition stability data on PB and BM samples showed that the majority of fresh samples shipped at room temperature and received by the laboratory within 48 hours are suitable for reliable testing, i.e. the clinical assay will not suffer of the significant samples loss due to pre-analytic manipulations as experienced with the cryopreserved samples in this study. The predictive value of this specific classifier, when applied to fresh samples, remains to be confirmed in a prospective clinical trial. 
     Regarding potential selection bias, patients were selected on the basis of specimen availability and, as expected, evaluable patients had relatively higher WBC counts and blast percentages when compared to the non-evaluable patients (Supplemental Table S3). Accuracy of predictions from DX SCNP  in BM sample subsets defined by clinical characteristics is shown in  FIG. 45 . While the small sample sizes do not permit definitive comparisons of classifier accuracy between subsets, it is notable that the AUROC for DX SCNP  is somewhat higher for patients with WBC count greater than the median of 19×109/L: 0.86 vs 0.60. The difference in prediction accuracy between sub-groups defined by Sex and Age are even less significant. 
     The purpose of this Example was to identify and validate a predictive classifier for response to standard induction therapy using as inputs intracellular functional pathway readouts. Despite the heterogeneity of the patient population studied (i.e. samples obtained from patients enrolled on different studies that were conducted over greater than a 10 year span) the SCNP classifier that was verified and validated (verification AUROC of 0.76, p=0.01 and validation AUROC=0.72, p=0.02) was quite robust. These data underscore that the biology identified and measured using SCNP is crucial to AML blast in vivo. The predictive ability and clinical utility of BH3 profiling, and how it compares to SCNP is currently unknown. 
     Compared with the BM Verification and Validation Analysis Sets, the BM Training Analysis Set had a lower percentage of patients with secondary AML, which was not a stratification factor during randomization (12% in Training vs. 29% in Verification and 19% in Validation). Although these differences were not statistically significant, likely due to the small sample size, the differences in biology of de novo and secondary AML could have affected model performance characteristics during the Verification and Validation phases, particularly in the PB Validation Analysis Set (PB prediction of response: AUROC 0.53, p=0.39). When paired (from the same patient) BM and PB samples were grouped by AML onset (de novo vs. secondary), the SCNP classifier scores were concordant between BM and PB in the de novo subset (Pearson R=0.7). Furthermore, DX SCNP  was a reliable (TABLE 49) predictor of response in the de novo Validation subgroup, (AUROC 0.71, p=0.044, and AUROC 0.79, p=0.02, for the BM and PB Validation Analysis Subsets, respectively). For the 10 patients with secondary AML in the PB Validation Analysis Subset, 5 had outcome of RD and all 5 were predicted incorrectly by DX SCNP . These findings are consistent with prior data, which indicated that the underlying biology of secondary AML is different from that of de novo AML [7] and that leukemic cell populations present in BM may have different characteristics from those found in PB. 
     In sum, the results of this study illustrate the ability of quantitative SCNP testing using functional flow cytometry to predict induction response in elderly AML patients. The assay provides accurate, independent data on disease biology and has the potential to inform treatment choices by allowing patients to avoid harmful treatment when it is likely futile, while offering the opportunity for those patients to consider enrollment in clinical trials evaluating new targeted and less intensive regimen as first line treatment. 
     REFERENCES 
     
         
         1. Walter R B, Appelbaum F R, Tallman M S, Weiss N S, Larson R A, et al. (2010) Shortcomings in the clinical evaluation of new drugs: acute myeloid leukemia as paradigm. Blood 116: 2420-2428. 
         2. Estey E, Dohner H (2006) Acute myeloid leukaemia. Lancet 368: 1894-1907. 
         3. Buchner T, Hiddemann W, Wormann B, Loffler H, Gassmann W, et al. (1999) Double induction strategy for acute myeloid leukemia: the effect of high-dose cytarabine with mitoxantrone instead of standard-dose cytarabine with daunorubicin and 6-thioguanine: a randomized trial by the German AML Cooperative Group. Blood 93: 4116-4124. 
         4. Lowenberg B, Ossenkoppele G J, van Putten W, Schouten H C, Graux C, et al. (2009) High-dose daunorubicin in older patients with acute myeloid leukemia. N Engl J Med 361: 1235-1248. 
         5. Krug U, Rollig C, Koschmieder A, Heinecke A, Sauerland M C, et al. (2010) Complete remission and early death after intensive chemotherapy in patients aged 60 years or older with acute myeloid leukaemia: a web-based application for prediction of outcomes. Lancet 376: 2000-2008. 
         6. Cheson B D, Bennett J M, Kopecky K J, Buchner T, Willman C L, et al. (2003) Revised recommendations of the International Working Group for Diagnosis, Standardization of Response Criteria, Treatment Outcomes, and Reporting Standards for Therapeutic Trials in Acute Myeloid Leukemia. Journal of clinical oncology: official journal of the American Society of Clinical Oncology 21: 4642-4649. 
         7. Komblau S M, Minden M D, Rosen D B, Putta S, Cohen A, et al. (2010) Dynamic single-cell network profiles in acute myelogenous leukemia are associated with patient response to standard induction therapy. Clinical cancer research: an official journal of the American Association for Cancer Research 16: 3721-3733. 
         8. Cesano A, Perbellini O, Evensen E, Chu C C, Cioffi F, et al. (2012) Association between B-cell receptor responsiveness and disease progression in B-cell chronic lymphocytic leukemia: results from single cell network profiling studies. Haematologica. 
         9. Lacayo N, Alonzo T A, Gayko U, Rosen D B, Westfall M, et al. (2013) Development and Validation of a Single-Cell Network Profiling (SCNP) Assay-based Classifier to Predict Response to Induction Therapy in Pediatric Patients with de novo Acute Myeloid Leukemia (AML): A Report from the Children&#39;s Oncology Group British Journal of Haematology. 
         10. Cesano A, Putta S, Rosen D B, Cohen A C, Gayko U, et al. (2013) Functional pathway analysis using SCNP of FLT3 receptor pathway deregulation in AML provides prognostic information independent from mutational status. PLoS ONE 8: e56714. 
         11. Rosen D B, Minden M D, Kornblau S M, Cohen A, Gayko U, et al. (2010) Functional characterization of FLT3 receptor signaling deregulation in acute myeloid leukemia by single cell network profiling (SCNP). PLoS ONE 5: e13543. 
         12. Godwin J E, Kopecky K J, Head D R, Willman C L, Leith C P, et al. (1998) A double-blind placebo-controlled trial of granulocyte colony-stimulating factor in elderly patients with previously untreated acute myeloid leukemia: a Southwest oncology group study (9031). Blood 91: 3607-3615. 
         13. Anderson J E, Kopecky K J, Willman C L, Head D, O&#39;Donnell M R, et al. (2002) Outcome after induction chemotherapy for older patients with acute myeloid leukemia is not improved with mitoxantrone and etoposide compared to cytarabine and daunorubicin: a Southwest Oncology Group study. Blood 100: 3869-3876. 
         14. Chauncey T R, Gundacker H, Shadman M, List A F, Dakhil S R, et al. (2010) Sequential phase II Southwest Oncology Group studies (SO0112 and S0301) of daunorubicin and cytarabine by continuous infusion, without and with ciclosporin, in older patients with previously untreated acute myeloid leukaemia. British Journal of Haematology 148: 48-58. 15. Rowe J M, Neuberg D, Friedenberg W, Bennett J M, Paietta E, et al. (2004) A phase 3 study of three induction regimens and of priming with G M-CSF in older adults with acute myeloid leukemia: a trial by the Eastern Cooperative Oncology Group. Blood 103: 479-485. 
         16. Cripe L D, Uno H, Paietta E M, Litzow M R, Ketterling R P, et al. (2010) Zosuquidar, a novel modulator of P-glycoprotein, does not improve the outcome of older patients with newly diagnosed acute myeloid leukemia: a randomized, placebo-controlled trial of the Eastern Cooperative Oncology Group 3999. Blood 116: 4077-4085. 
         17. Pocock S J, Simon R (1975) Sequential treatment assignment with balancing for prognostic factors in the controlled clinical trial. Biometrics 31: 103-115. 
         18. Cesano A, Putta S, Mathi K, Rosen D B, Gayko U, et al. (2011) Single cell network profiling (SCNP) functionally characterizes FLT3 pathway deregulation in non-M3 acute myeloid leukemia (AML) and provides prognostic value independent from mutational status. Blood (ASH Annual Meeting Abstracts) 118: Abstract 2512. 
         19. Lee J A, Spidlen J, Boyce K, Cai J, Crosbie N, et al. (2008) MIFlowCyt: the minimum information about a Flow Cytometry Experiment. Cytometry A 73: 926-930. 
         20. Cesano A, Rosen D B, O&#39;Meara P, Putta S, Gayko U, et al. (2012) Functional pathway analysis in acute myeloid leukemia using Single Cell Network Profiling (SCNP) assay: effect of specimen source (bone marrow or peripheral blood) on assay readouts. Cytometry Part B 82: 158-172. 
         21. Goeman J J (2010) L1 penalized estimation in the Cox proportional hazards model. Biometrical journal Biometrische Zeitschrift 52: 70-84. 
         22. Breiman L (2001) Random Forests. Machine Learning 45: 5-32. 
         23. Harrell F E, Jr. (2001) Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis. New York: Springer-Verlag. 
         24. Firth D (1993) Bias Reduction of Maximum Likelihood Estimates. Biometrika 80: 41. 
         25. Hollander MaW, D. A. (1999) Nonparametric Statistical Methods: John Wyley and Sons, Inc. 779 p. 
         26. Law A, and, Wiener M (2002) Classifications and Regression by random Forest. R News. 
         27. Pepe M S (2003) The Statistical Evaluation of Medical Tests for Classification and Prediction. New York: Oxford University Press. 
         28. Mason S J G, N. E. (2002) Areas beneath the relative operating characteristics (ROC) and relative operating levels (ROL) curves: Statistical significance and interpretation. Q J R Meteorological Society 128: 21. 
         29. Obuchowski N A, Lieber M L (1998) Confidence intervals for the receiver operating characteristic area in studies with small samples. Academic radiology 5: 561-571. 
         30. Lacayo N J, Alonzo T A, Gayko U, Westfall M, Purvis N, et al. (2011) Single cell network profiling (SCNP)-based classifier to predict response to induction therapy in pediatric patients with de novo acute myeloid leukemia (AML): validation study results. Blood (ASH Annual Meeting Abstracts) 118: Abstract 3544. 
         31. Buchner T, Berdel W E, Haferlach C, Haferlach T, Schnittger S, et al. (2009) Age-related risk profile and chemotherapy dose response in acute myeloid leukemia: a study by the German Acute Myeloid Leukemia Cooperative Group. Journal of clinical oncology: official journal of the American Society of Clinical Oncology 27: 61-69. 
         32. Grimwade D, Walker H, Harrison G, Oliver F, Chatters S, et al. (2001) The predictive value of hierarchical cytogenetic classification in older adults with acute myeloid leukemia (AML): analysis of 1065 patients entered into the United Kingdom Medical Research Council AML11 trial. Blood 98: 1312-1320. 
         33. Walter R B, Othus M, Borthakur G, Ravandi F, Cortes J E, et al. (2011) Prediction of early death after induction therapy for newly diagnosed acute myeloid leukemia with pretreatment risk scores: a novel paradigm for treatment assignment. Journal of clinical oncology: official journal of the American Society of Clinical Oncology 29: 4417-4423. 
         34. Cesano A, Gotlib J R, Lacayo N J, Putta S, Lackey A, et al. (2010) Sample Cryopreservation Does Not Affect Functional Read Outs In SCNP Assays: Implications for Biomarker Development. Blood (ASH Annual Meeting Abstracts) 116: 4843. 
         35. Vo T T, Ryan J, Carrasco R, Neuberg D, Rossi D J, et al. (2012) Relative mitochondrial priming of myeloblasts and normal HSCs determines chemotherapeutic success in AML. Cell 151: 344-355. 
       
    
     Supplemental Data: 1. 1 Clinical Data 
     Clinical data, including baseline disease characteristics such as age, gender, cytogenetics, and AML onset (i.e., de-novo versus secondary AML), as well as induction and consolidation therapy information and associated outcomes, were collected and recorded for the parent SWOG studies S9031, S9333, S0112 and S0301 and ECOG studies E3993 and E3999 (see Supplemental Table S2). The clinical data for the training, verification and validation sets were only released to Nodality after experimental data for the respective study phase had completed QC and data lock. Missing pretreatment data values were estimated by either pre-defined rules (blood counts) or nearest neighbor imputation for use in clinical predictors of response. 
     
       
         
           
               
            
               
                   
               
               
                 Supplemental Table S1: SWOG and ECOG Treatment Study Details 
               
            
           
           
               
               
               
               
               
            
               
                   
                 Enrollment 
                   
                   
                   
               
               
                   
                 Dates, 
                   
                   
                   
               
               
                   
                 Enrolled/ 
                   
                   
                   
               
               
                 Study # and  
                 Analysis 
                 Eligibility 
                   
                   
               
               
                 Short Title 
                 Set 
                 Criteria 
                 Treatment 
                 Outcomes 
               
               
                   
               
               
                 SWOG-9031 
                 1992-1994 
                 Age 56+, 
                 Induction: Ara-C: 200 
                 CR Rates: 
               
               
                 Phase III placebo- 
                 234 
                 newly 
                 mg/m2/d CIV D1-7 and 
                 Placebo: 50%; 
               
               
                 controlled trial of 
                 enrolled 
                 diagnosed  
                 DNR: 45 mg/m2 IVP 
                 G-CSF: 41% 
               
               
                 Ara-C/Dauno +/− 
                 211 
                 AML 
                 D1-3 plus: 
                 (p = 0.89)/Overall:  
               
               
                 G-CSF in elderly pts 
                 included in 
                 M1-7 
                 Either placebo or 
                 45% (95/211) 
               
               
                 with untreated AML 
                 analyses 
                 (excluding 
                 G-CSF once daily 
                 RD Rate: RD 
               
               
                   
                   
                 M3), 
                 Post-CR: Ara-C: 200 
                 35% 
               
               
                   
                   
                 de novo 
                 mg/m2/d CIV D1-5 
                 Fatal Ind 
               
               
                   
                   
                 or 
                 DNR: 30 mg/m2 IVP 
                 Tox/Death w/in 
               
               
                   
                   
                 secondary 
                 D1-2 plus: 
                 7 days of 
               
               
                   
                   
                   
                 Either placebo (Arm 1) 
                 treatment: 
               
               
                   
                   
                   
                 or G-CSF once daily 
                 20%/not 
               
               
                   
                   
                   
                 (Arm 2) 
                 reported 
               
               
                   
                   
                   
                   
                 Med RFS: PBO: 
               
               
                   
                   
                   
                   
                 9 mo; G-CSF: 8 
               
               
                   
                   
                   
                   
                 mo (NS) 
               
               
                   
                   
                   
                   
                 Med. OS: 
               
               
                   
                   
                   
                   
                 Placebo: 9 mos; 
               
               
                   
                   
                   
                   
                 G-CSF: 6 mos. 
               
               
                   
                   
                   
                   
                 (p = .71) 
               
               
                 SWOG-9333 
                 1995-1998 
                 Age 56+, 
                 Induction-Patients 
                 CR Rates: ME: 
               
               
                 Phase III randomized 
                 334 
                 newly 
                 from Arm 1 (only) 
                 34%; AD: 43% 
               
               
                 trial of 
                 enrolled 
                 diagnosed  
                 eligible for SCNP 
                 (p = 0.96) 
               
               
                 Mitoxantrone/ 
                 328 
                 AML 
                 study: 
                 Overall: 38% 
               
               
                 Etoposide (ME) vs.  
                 included in 
                 M1-7 
                 Arm 1-AD: Ara-C: 200 
                 (125/328) 
               
               
                 Ara-C/Dauno (AD)  
                 analyses 
                 (excluding  
                 mg/m2/d CIV D1-7 and 
                 RD Rate: 39% 
               
               
                 in elderly pts with 
                 (Arm 1 
                 M3), 
                 DNR: 45 mg/m2 IVP 
                 Fatal Ind Tox/ 
               
               
                 untreated AML 
                 [AD]: 
                 de novo 
                 D1-3 plus: 
                 Death w/in 7 
               
               
                   
                 162 
                 or 
                 GM-CSF once daily 
                 days of 
               
               
                   
                 enrolled 
                 secondary 
                 Arm 2-ME: 
                 treatment: 
               
               
                   
                 161 
                   
                 mitoxantrone 10 
                 18%/7% 
               
               
                   
                 included in 
                   
                 mg/m2/d × 5 d and 
                 Med RFS: ME: 
               
               
                   
                 analyses) 
                   
                 etoposide 100 
                 7 mo; AD: 9 mo 
               
               
                   
                   
                   
                 mg/m2/d × 5 d 
                 (NS) 
               
               
                   
                   
                   
                 Post-CR: Ara-C: 200 
                 OS @ 2 yrs: 
               
               
                   
                   
                   
                 mg/m2 CIV D1-5 and 
                 ME: 11%; AD: 
               
               
                   
                   
                   
                 DNR: 30 mg/m2 IVP 
                 19%. (p = .99) 
               
               
                   
                   
                   
                 D1-2 plus: 
                   
               
               
                   
                   
                   
                 GM-CSF once daily 
                   
               
               
                 SWOG-S0112 
                 2001-2003 
                 Age 56+, 
                 Induction: Ara-C: 200 
                 CR Rate: 38% 
               
               
                 Phase II trial of 
                 N = 71 
                 newly 
                 mg/m2/d CIV d1-7 and 
                 (23/60) 
               
               
                 Ara-C/Dauno in elderly  
                 enrolled 
                 diagnosed  
                 DNR: 45 mg/m2 IVP 
                 RD Rate: 45% 
               
               
                 pts with untreated AML  
                 60 included  
                 AML 
                 d1-3 plus: 
                 Fatal Ind Tox/ 
               
               
                 (single arm) 
                 in analyses  
                 M1-7 
                 rhGM-GSF or G-CSF 
                 Death w/in 7 
               
               
                   
                   
                 (excluding 
                 Post-CR: Ara-C: 200 
                 days of 
               
               
                   
                   
                 M3), 
                 mg/m2 CIV d1-5 and 
                 treatment: 
               
               
                   
                   
                 de novo 
                 DNR: 45 mg/m2 IVP 
                 17%/7% 
               
               
                   
                   
                 or 
                 d1-2 
                 Med RFS: 8 mo 
               
               
                   
                   
                 secondary 
                   
                 Med. OS: 7 mos. 
               
               
                 SWOG-S0301 
                 2003-2006 
                 Age 56+, 
                 Induction: Ara-C: 200 
                 CR Rate: 44% 
               
               
                 Phase II trial of 
                 55 enrolled  
                 newly 
                 mg/m2/d CIV D1-7 and 
                 (22/50) 
               
               
                 Ara-C/Dauno plus 
                 50 included 
                 diagnosed  
                 DNR: 45 mg/m2 IVP 
                 RD Rate: 43% 
               
               
                 Cyclosporin-A in 
                 in analyses 
                 AML 
                 d1-3 plus: 
                 Fatal Ind Tox/ 
               
               
                 elderly pts with 
                   
                 M1-7 
                 Cyclosporine 6 mg/kg 
                 Death w/in 7 
               
               
                 untreated AML  
                   
                 (excluding 
                 IV hrs −2 to 0, then 
                 days of 
               
               
                 (single arm) 
                   
                 M3), 
                 16 mg/kg/d CIV d1-3; 
                 treatment: 
               
               
                   
                   
                 de novo 
                 rhGM-GSF or G-CSF 
                 12%/8% 
               
               
                   
                   
                 or 
                 Post-CR: Ara-C: 200 
                 Med RFS: 14 
               
               
                   
                   
                 secondary 
                 mg/m2 CIV d1-5 and 
                 mo 
               
               
                   
                   
                   
                 DNR: 45 mg/m2 IVP 
                 Med. OS: 14 
               
               
                   
                   
                   
                 d1-2 plus: 
                 mos. 
               
               
                   
                   
                   
                 Cyclosporine 6 mg/kg 
                   
               
               
                   
                   
                   
                 IV hrs −2 to 0 then 
                   
               
               
                   
                   
                   
                 16 mg/kg/d IV CIV d1-2 
                   
               
               
                 ECOG-E3993 
                 1993-1997 
                 Age 56 
                 Induction (all pts): 1-2 
                 “Comparison of 
               
               
                   
                 362 
                 M0-M7 
                 cycles Ara-C (100 
                 CR rates among 
               
               
                   
                 enrolled 
                 AML 
                 mg/m2/d) × 7 days 
                 3 induction 
               
               
                   
                   
                 No prior 
                 PLUS- 
                 regimens 
               
               
                   
                   
                 RT/CT 
                 RANDOMIZE: 
                 (primary 
               
               
                   
                   
                 De novo 
                 Daunorubicin 45 
                 endpoint): no 
               
               
                   
                   
                 or 
                 mg/m2/d × 3 d VS. 
                 statistically 
               
               
                   
                   
                 secondary 
                 Idarubicin 12  
                 significant 
               
               
                   
                   
                   
                 mg/m2/d × 3 d VS. 
                 difference. 
               
               
                   
                   
                   
                 Mitoxantrone 12 
                 Comparison of 
               
               
                   
                   
                   
                 mg/m2/d × 3 d. 
                 CR rates btwn 
               
               
                   
                   
                   
                 Post-CR: 1 cycle Ara-  
                 GM-CSF vs. 
               
               
                   
                   
                   
                 C (1.5 gm/m2) q. 12 
                 PB0 (co-primary 
               
               
                   
                   
                   
                 hrs × 12 doses 
                 endpoint): no 
               
               
                   
                   
                   
                 &gt;70 yrs. old: 6 doses 
                 statistically 
               
               
                   
                   
                   
                   
                 significant 
               
               
                   
                   
                   
                   
                 difference. 
               
               
                 ECOG-E3999 
                 2002-2006 
                 Age 60+ 
                 Induction (all pts): 1-2 
                 No difference in 
               
               
                   
                 449 
                 AML M0- 
                 cycles 7 + 3 Ara-C (100 
                 median OS 
               
               
                   
                 enrolled 
                 M7, 
                 mg/m2/d)/Daunorubicin  
                 (primary 
               
               
                   
                   
                 exclude 
                 (45 mg/m2/d) 
                 endpoint). 
               
               
                   
                   
                 M3 
                 RANDOMIZE: 
                 No difference in 
               
               
                   
                   
                 No prior 
                 zosuquidar 
                 median O.S. of 
               
               
                   
                   
                 CT 
                 trihydrochloride IV 
                 pts with high P- 
               
               
                   
                   
                 De novo 
                 days 1-3 vs. PBO 
                 gp status. 
               
               
                   
                   
                 or 
                 Growth factor support: 
                   
               
               
                   
                   
                 secondary 
                 G-CSF or GM-CSF 
                   
               
               
                   
                   
                   
                 start D12 to ANC 
                   
               
               
                   
                   
                   
                 recovery 
                   
               
               
                   
                   
                   
                 Consolidation I (all 
                   
               
               
                   
                   
                   
                 pts in CR): 1 cycle Ara- 
                   
               
               
                   
                   
                   
                 C (1.5 gm/m2) q. 12 
                   
               
               
                   
                   
                   
                 hrs × 12 doses 
                   
               
               
                   
                   
                   
                 Growth factor support: 
                   
               
               
                   
                   
                   
                 G-CSF or GM-CSF 
                   
               
               
                   
                   
                   
                 start D7 to ANC 
                   
               
               
                   
                   
                   
                 recovery 
                   
               
               
                   
                   
                   
                 Consolidation II (all 
                   
               
               
                   
                   
                   
                 pts in CR): repeat 
                   
               
               
                   
                   
                   
                 induction regimen × 1 
                   
               
               
                   
                   
                   
                 cycle 
               
               
                   
               
            
           
         
       
     
     
       
         
           
               
             
               
                 SUPPLEMENTAL TABLE S3 
               
             
            
               
                   
               
               
                 Baseline characteristics of patients on SWOG trials: SCNP-evaluable vs. all other  
               
               
                 eligible, evaluable who did not decline consent for specimen. 
               
            
           
           
               
               
               
               
               
               
            
               
                   
                   
                 SCNP- 
                   
                   
                   
               
               
                   
                   
                 evaluable 
                 All Others  a   
                   
                   
               
               
                 Patient/Disease 
                   
                 (N = 213) 
                 (N = 294) 
                   
                   
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                 Characteristics 
                 Sub-Groups 
                 N 
                 % 
                 N 
                 % 
                 P 
                 Test 
               
               
                   
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                 Study/Arm 
                 S9031/AD 
                 45 
                 21.1% 
                 68 
                 23.1% 
                 &lt;.0001 
                 ChiSq 
               
               
                   
                 S9031/AD + G 
                 27 
                 12.7% 
                 84 
                 28.6% 
                   
                   
               
               
                   
                 S9333/AD 
                 70 
                 32.9% 
                 91 
                 31.0% 
                   
                   
               
               
                   
                 S0112/AD 
                 29 
                 13.6% 
                 30 
                 10.2% 
                   
                   
               
               
                   
                 S0301/AD + C 
                 42 
                 19.7% 
                 21 
                  7.1% 
                   
                   
               
               
                 Sex 
                 F 
                 94 
                 44.1% 
                 131 
                 44.6% 
                 0.93 
                 Fisher 
               
               
                   
                 M 
                 119 
                 55.9% 
                 163 
                 55.4% 
                   
                   
               
               
                 AML Onset 
                 De Novo 
                 162 
                 76.1% 
                 227 
                 77.5% 
                 0.75 
                 Fisher 
               
               
                   
                 Secondary 
                 51 
                 23.9% 
                 66 
                 22.5% 
                   
                   
               
               
                   
                 Unknown 
                 0 
                 . 
                 1 
                 . 
                   
                   
               
               
                 SWOG PS 
                 0 
                 58 
                 27.5% 
                 69 
                 24.0% 
                 0.41 
                 ChiSq 
               
               
                   
                 1 
                 98 
                 46.4% 
                 148 
                 51.6% 
                   
                   
               
               
                   
                 2 
                 31 
                 14.7% 
                 47 
                 16.4% 
                   
                   
               
               
                   
                 3 
                 24 
                 11.4% 
                 23 
                  8.0% 
                   
                   
               
               
                   
                 Unknown 
                 2 
                 . 
                 7 
                 . 
                   
                   
               
               
                 Cytogenetics 
                 Normal 
                 73 
                 42.7% 
                 75 
                 34.7% 
                 0.0037 
                 ChiSq 
               
               
                   
                 Nml +  
                 4 
                  2.3% 
                 9 
                  4.2% 
                   
                   
               
               
                   
                 Nonclonal 
                   
                   
                   
                   
                   
                   
               
               
                   
                 del5q7q 
                 24 
                 14.0% 
                 61 
                 28.2% 
                   
                   
               
               
                   
                 CBF 
                 16 
                  9.4% 
                 9 
                  4.2% 
                   
                   
               
               
                   
                 Other 
                 54 
                 31.6% 
                 62 
                 28.7% 
                   
                   
               
               
                   
                 Unknown 
                 42 
                 . 
                 78 
                 . 
                   
                   
               
               
                 Age (Years) 
                 (Min, Max) 
                 (57, 69)  
                   
                 (56, 85)  
                   
                 0.13 
                 Wilcoxon 
               
               
                   
                 Median 
                 68.6 
                   
                 67.1 
                   
                   
                   
               
               
                 BM blasts (%) 
                 (Min, Max) 
                 (6, 99) 
                   
                 (0, 99) 
                   
                 0.003 
                 Wilcoxon 
               
               
                   
                 Median 
                 68 
                   
                 60 
                   
                   
                   
               
               
                 WBC (10 9 /L) 
                 (Min, Max) 
                 (0.7, 298)  
                   
                 (0.6, 294)  
                   
                 &lt;.0001 
                 Wilcoxon 
               
               
                   
                 Median 
                 22  
                   
                 5.1 
                   
                   
                   
               
               
                 PB blasts (%) 
                 (Min, Max) 
                 (0, 99) 
                   
                 (0, 95) 
                   
                 &lt;.0001 
                 Wilcoxon 
               
               
                   
                 Median 
                 40 
                   
                 13 
                   
                   
                   
               
               
                   
               
               
                   a  Includes N = 241 with insufficient material for assay and N = 53 assayed but with nonevaluable results (see FIG. 1) 
               
            
           
         
       
     
     Data Analysis Methods 
     1.2 Inputs for the SCNP-Based Classifier: Node Assay Panel 
     The full list of signaling nodes in the assay panel for this study (n=53) is shown in Supplemental Table S3. A signaling node is defined as a combination of a modulator with an intracellular read out. Approximately 2×10 6  cells were required to run the full planned panel of signaling nodes (53 nodes). However for some patients, due to lower total number of viable cells in the sample post thaw and ficoll, SCNP data was collected for only a subset of the planned nodes. In order to avoid data imputation, SCNP data from the 35 highest priority nodes (see Supplemental Table S3) was used to develop the SCNP-based classifier. 
     After completion of the SCNP assay, the following pre-specified criteria for determining evaluable BMMC and PBMC samples were applied: 1) a minimum of 25% healthy cells measured as the percentage of cPARP negative cells in the viable leukemic blast population, 2) a minimum of 500 viable healthy cells per well in the leukemic cell gate, 3) SCNP data available for the 35 highest priority nodes and 4) the absence of any technical assay deviation. SCNP readout data were stored on a secure restricted-access server. 

 
     1.3 Randomization 
     After receiving the list of evaluable samples, the SWOG Statistical Center identified the evaluable SWOG patients (i.e. patients having an evaluable sample: BM, PB or both), who were then randomized approximately 1:1 between the Training and Validation Sets. The Pocock-Simon method was used to ensure near balance for each of the following variables: 
     Induction response: CR/CRi duration &lt;1 year vs. CR/CRi duration &gt;1 year vs. resistant disease (RD) vs. fatal induction toxicity (FIT) or early death (ED) in the absence of FIT 
     Pre-treatment specimen availability: BM only vs. PB only vs. both 
     Cytogenetic risk group: core binding factor vs. cytogenetically normal vs. poor risk (defined by total/partial deletion of 5q and/or 7q) vs. unknown vs. all others 
     Parent trial treatment arm: SWOG-9031 arm 1 vs. SWOG-9031 arm 2 vs. S9333 arm 1 vs. SO112 vs. S0301 (see Supplemental Table S2 for treatment regimens) 
     FLT3-ITD mutational status (BM): Yes vs. No vs. unknown 
     FLT3-ITD mutational status (PB): Yes vs. No vs. unknown 
     BM Specimen Evaluability*: 
     Data available for all proteomic readouts vs. data available for minimum required proteomic readouts vs. not evaluable 
     PB Specimen Evaluability*: 
     Data available for all proteomic readouts vs. data available for minimum required proteomic readouts vs. not evaluable *Randomization was applied to patients, not specimens; therefore, each patient was stratified on the basis of pretreatment BM specimen evaluability, and on the basis of pretreatment PB specimen evaluability. 
     After SWOG uploaded the patient randomization list to the secure website, Nodality isolated raw data (i.e., FCS files/gating files) for the validation set on a restricted-access server location. Nodality staff then calculated node-metrics for the Training Set only. 
     1.4 Variable Selection 
     The form of the relationship between node-metrics and binary outcomes (response to induction therapy) were investigated using random forest (Breiman, 2003 and Liaw and Wiener, 2002), penalized logistic regression (Goemann, 2010), traditional logistic regression with natural spline functions (Harrell, 2001), and loess regression (Harrell, 2001). Logistic regression, using natural spline transformations, and loess regression, when applied, helps identify non-linear functional forms and suggest transformations that strengthen the association with the outcome. Functional forms were also investigated by examining partial dependence plots (random forest) and model residuals (logistic and proportional hazards regression). 
     The Random Forest method was used for identifying a subset of variables whose relationship with the outcome can be represented as a step function (monotonic or non-monotonic) or involves an interaction with other variables. Penalized logistic regression was used for identifying subsets of variables that have strong linear relationships with the outcome. 
     Node-metrics that were ranked low (i.e., weak association with the outcome of interest) by both random forest and penalized logistic regression methods, had a low rank-order correlation (e.g. Spearman correlation coefficient or Somers&#39; D) with the outcome, and/or which did not exhibit a functional form that could be modeled with a simple transformation (i.e. using few degrees of freedom), were excluded from further consideration as predictors of that outcome. 
     In an effort to further reduce the dimensionality of the modeling effort (i.e. the number of node-metric candidates under consideration) for a given outcome, measures of association were contrasted for modulator-antibody combinations (nodes) measured by alternative metrics, after appropriate transformations were applied. If one metric yielded consistently stronger relationships with the outcome compared to an alternative, the alternative metric was excluded from further consideration. 
     The impact of the following factors on the strength and form of the relationship between each node-metric and the outcome was investigated: percent health, cell maturity, cytogenetics, FLT3R ITD mutational status (binary and continuous), and completion of induction therapy. The strength and form of the relationship between each node-metric and the induction response outcome were investigated separately in the set of all evaluable patients and in the subset excluding induction deaths. If relationships between node-metrics and outcomes were sufficiently different, as a function of any such factors, those factors were accounted for through adjustment of node-metric signals, incorporation of those factors into the modeling process, or development of separate models. After appropriate transformations were identified and apparently poor predictors and/or inferior metrics were excluded from further consideration, the remaining candidates were evaluated as predictors of the outcome in different multivariate models. 
     1.5 Imputation of clinical data for the development of DX CLINICAL1  and DX CLINICAL2  Among the variables included in the development of DX CLINICAL1  and DX CLINICAL2 , data were not available for 1-6% of the patients for following variables: absolute blast count, percentage of blasts, monocytes, neutrophils, FLT3 ITD status, NPM1 mutational status, race, hemoglobin, and/or platelet count data. The following process was followed to impute the missing data: 
     a. Missing absolute blast count was estimated from WBC values using a linear function. The linear function was obtained by regressing absolute blast count against WBC for those donors for whom both values were available. 
     b. Missing percentage blasts value were then computed as 
     
       
         
           
             
               % 
                
               
                   
               
                
               blast 
             
             = 
             
               
                 100 
                 * 
                 
                   ( 
                   
                     absolute 
                      
                     
                         
                     
                      
                     blast 
                      
                     
                         
                     
                      
                     count 
                   
                   ) 
                 
               
               WBC 
             
           
         
       
     
     c. Percentage monocytes (where possible) were computed as 
       % monocytes=100.0−% blast−% neutrophils−% lymphocytes
 
     d. Absolute monocyte count was then computed as 
     
       
         
           
             
               abs 
               . 
               
                   
               
                
               monocytes 
             
             = 
             
               
                 
                   ( 
                   
                     % 
                      
                     
                         
                     
                      
                     monocytes 
                   
                   ) 
                 
                 * 
                 
                   ( 
                   WBC 
                   ) 
                 
               
               100 
             
           
         
       
     
     e. Where possible, similar strategy shown in items c and d was employed to impute missing data for percentage of neutrophils and absolute neutrophil counts 
     
       
         
           
             
               % 
                
               
                   
               
                
               neutrophils 
             
             = 
             
               100.0 
               - 
               
                 % 
                  
                 
                     
                 
                  
                 blast 
               
               - 
               
                 % 
                  
                 
                     
                 
                  
                 monocytes 
               
               - 
               
                 % 
                  
                 
                     
                 
                  
                 lymphocytes 
               
             
           
         
       
       
         
           
             
               abs 
               . 
               
                   
               
                
               neutrophils 
             
             = 
             
               
                 
                   ( 
                   
                     % 
                      
                     
                         
                     
                      
                     neutrophils 
                   
                   ) 
                 
                 * 
                 
                   ( 
                   WBC 
                   ) 
                 
               
               100 
             
           
         
       
     
     f. FLT3 ITD mutation status for all donors with missing data was set to wild type (WT) 
     g. Similarly NPM1 mutation status for all donors with missing data was set to WT 
     h. The remaining missing data (a maximum 3% for any of the variable) was imputed using k-Nearest Neighbhor (KNN) method implemented in imputation library in R software. This method was applied to the data after the variables WBC, neutrophil, blast, monocyte, absolute neutrophil count, and platelet counts have been transformed to a log scale, followed by scaling of the data to zero mean and unit variance (z-transform). The variables included in the k-nearest neighbor computation are: age, percentage of blast, monocytes, neutrophils, absolute counts of neutrophils, blast, monocytes, platelet count, hemoglobin and FAB (categorized as 0 or 1 for mature and immature). 
     1.6 Clinical Predictor DX CLINICAL2    
     The clinical predictor DX CLINICAL2  was a logistic function of the form DX CLINICAL2 =e χ′{circumflex over (β)} /(1+e χ′{circumflex over (β)} ), where χ is the vector of input parameters and {circumflex over (λ)} is the vector of estimated regression coefficients. Based on the N=74 patients in the Training Set, the predictor was defined as follows: 
     
       
         
           
               
               
               
             
               
                   
                   
               
               
                   
                   
                 Estimated  
               
               
                   
                   
                 regression 
               
               
                   
                 Input parameter 
                 coefficient 
               
               
                   
                   
               
             
            
               
                   
               
            
           
           
               
               
               
            
               
                   
                 χ 0 : Intercept = 1 for all patients 
                 1.1165444 
               
               
                   
                 χ 1 : Cytogenetic risk group =  
                 −0.9532412 
               
               
                   
                 1 for Poor Risk, 0 for all others 
                   
               
               
                   
                 χ 2 : NPM1 mutation status =  
                 0.3518013 
               
               
                   
                 1 for mutant, 0 for wildtype 
                   
               
               
                   
                 X 3 : FLT3/NPM1 status =  
                 0.4051878 
               
               
                   
                 1 for ITD/mutant, 0 for all others 
               
               
                   
                   
               
            
           
         
       
     
     Note that the three included parameters are all dichotomous and define 6 possible values of DX CLINICAL2 . The following table summarizes DX CLINICAL2  and the corresponding response rates in the Training and Validation Sets: 
     
       
         
           
               
               
               
               
               
               
             
               
                   
               
               
                 Cyto 
                   
                   
                   
                   
                   
               
               
                 genetic 
                   
                   
                   
                   
                 Validation  
               
               
                 risk  
                 NPM1 
                 FLT3- 
                 DX CLIN-   
                 Training Set 
                 Set 
               
               
                 group 
                 status 
                 ITD 
                 
                   ICAL2 
                 
                 CR/N (%) 
                 CR/N (%) 
               
               
                   
               
             
            
               
                   
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                 Poor  
                 Mutant 
                 ITD+ 
                 72% 
                 0/0  
                 (—) 
                 2/2 
                 (100%) 
               
               
                 risk 
                   
                   
                   
                   
                   
                   
                   
               
               
                   
                 Mutant 
                 ITD− 
                 63% 
                 0/0 
                 (—) 
                 1/1 
                 (100%) 
               
               
                   
                 Wildtype 
                 Either 
                 54% 
                 4/10  
                 (40%) 
                 6/9  
                 (67%) 
               
               
                 Any  
                 Mutant 
                 ITD+ 
                 87% 
                 11/11  
                 (100%) 
                 9/9 
                 (100%) 
               
               
                 other 
                   
                   
                   
                   
                   
                   
                   
               
               
                   
                 Mutant 
                 ITD− 
                 81% 
                 16/19 
                 (84%) 
                 7/8 
                 (88%) 
               
               
                   
                 Wildtype 
                 Either 
                 75% 
                 25/34 
                 (74%) 
                 31/43 
                 (72%) 
               
               
                   
               
            
           
         
       
     
     1. 7 Validation Methods 
     Upon SWOG&#39;s confirmation of receipt of the final, locked classifier, Nodality calculated the SCNP node-metrics for the SWOG Validation Analysis Set and the final predictions using Nodality-developed software (validated for this intended use). The final predictions were transferred to SWOG, who then provided the final clinical outcomes. The performance of the classifiers was evaluated independently at Nodality and at either SWOG or ECOG (for each group&#39;s own respective datasets). 
     1.8 Node-Metric Data 
     SCNP node-metrics that are used as inputs to DX SCNP  are shown in Supplemental Table S4 below for the BM Training, PB Training, BM Validation and PB Validation Analysis Sets along with the response information, tissue type and analysis set. 
     
       
         
           
               
             
               
                 SUPPLEMENTAL TABLE S4 
               
             
            
               
                   
               
               
                 Node-metric and reponse data for Training and Validaiton analysis sets 
               
            
           
           
               
               
               
               
               
               
               
            
               
                   
                   
                 AraC + Dauno  
                 AraC + Dauno  
                   
                   
                   
               
               
                 Patient 
                   
                 (24 Hours) →  
                 (24 Hours) →  
                   
                   
                   
               
               
                 ID 
                 Sample 
                 CD 34 | Uu 
                 cPARP | Uu 
                 Response 
                 Set 
                 Tissue 
               
               
                   
               
            
           
           
               
               
               
               
               
               
               
            
               
                 Train063 
                 2004 
                 0.3584 
                 0.5 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train027 
                 2021 
                 0.3871 
                 0.5729 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train074 
                 2027 
                 0.4469 
                 0.5522 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train057 
                 2041 
                 0.3305 
                 0.525 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train039 
                 2043 
                 0.3216 
                 0.6984 
                 RD 
                 Training 
                 BM 
               
               
                 Train037 
                 2044 
                 0.4553 
                 0.534 
                 RD 
                 Training 
                 BM 
               
               
                 Train072 
                 2048 
                 0.4884 
                 0.5164 
                 RD 
                 Training 
                 BM 
               
               
                 Train077 
                 2075 
                 0.2449 
                 0.7132 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train018 
                 2108 
                 0.2694 
                 0.5548 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train091 
                 2112 
                 0.2866 
                 0.585 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train080 
                 2113 
                 0.3421 
                 0.5803 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train044 
                 2121 
                 0.4841 
                 0.524 
                 RD 
                 Training 
                 BM 
               
               
                 Train003 
                 2129 
                 0.2639 
                 0.5527 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train056 
                 2151 
                 0.4662 
                 0.5784 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train049 
                 2158 
                 0.3819 
                 0.5 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train065 
                 2179 
                 0.387 
                 0.5 
                 RD 
                 Training 
                 BM 
               
               
                 Train002 
                 2220 
                 0.2533 
                 0.6604 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train009 
                 2253 
                 0.2751 
                 0.6112 
                 RD 
                 Training 
                 BM 
               
               
                 Train103 
                 2255 
                 0.1877 
                 0.5774 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train014 
                 2257 
                 0.1625 
                 0.5419 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train045 
                 2266 
                 0.3843 
                 0.6435 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train075 
                 2273 
                 0.5 
                 0.5297 
                 RD 
                 Training 
                 BM 
               
               
                 Train006 
                 2291 
                 0.4482 
                 0.5672 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train108 
                 2295 
                 0.1858 
                 0.7287 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train048 
                 2296 
                 0.3512 
                 0.7469 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train032 
                 2297 
                 0.3629 
                 0.6483 
                 RD 
                 Training 
                 BM 
               
               
                 Train070 
                 2302 
                 0.1975 
                 0.5 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train031 
                 2306 
                 0.0962 
                 0.5478 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train099 
                 2315 
                 0.2756 
                 0.7284 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train043 
                 2332 
                 0.42 
                 0.5349 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train050 
                 2338 
                 0.4448 
                 0.5291 
                 RD 
                 Training 
                 BM 
               
               
                 Train058 
                 2341 
                 0.4319 
                 0.577 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train013 
                 2352 
                 0.2835 
                 0.7707 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train055 
                 2370 
                 0.2331 
                 0.5 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train030 
                 2372 
                 0.414 
                 0.5619 
                 RD 
                 Training 
                 BM 
               
               
                 Train034 
                 2389 
                 0.3809 
                 0.5583 
                 RD 
                 Training 
                 BM 
               
               
                 Train017 
                 2395 
                 0.1635 
                 0.5395 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train024 
                 2398 
                 0.4787 
                 0.5 
                 RD 
                 Training 
                 BM 
               
               
                 Train012 
                 2402 
                 0.3077 
                 0.5997 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train101 
                 2408 
                 0.1555 
                 0.627 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train028 
                 2421 
                 0.2373 
                 0.5627 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train062 
                 2429 
                 0.2084 
                 0.5931 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train100 
                 2433 
                 0.2266 
                 0.5895 
                 CR/CRi 
                 Training 
                 BM 
               
               
                 Train030 
                 2007 
                 0.463 
                 0.5774 
                 RD 
                 Training 
                 PB 
               
               
                 Train012 
                 2028 
                 0.2827 
                 0.5743 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train089 
                 2031 
                 0.3904 
                 0.6575 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train103 
                 2032 
                 0.1992 
                 0.5794 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train061 
                 2061 
                 0.3723 
                 0.5886 
                 RD 
                 Training 
                 PB 
               
               
                 Train085 
                 2066 
                 0.2336 
                 0.7488 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train088 
                 2077 
                 0.3422 
                 0.7695 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train079 
                 2078 
                 0.2094 
                 0.5 
                 RD 
                 Training 
                 PB 
               
               
                 Train037 
                 2085 
                 0.4395 
                 0.5561 
                 RD 
                 Training 
                 PB 
               
               
                 Train074 
                 2094 
                 0.4474 
                 0.5 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train045 
                 2111 
                 0.3656 
                 0.6191 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train043 
                 2120 
                 0.442 
                 0.5721 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train052 
                 2126 
                 0.3691 
                 0.6417 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train017 
                 2154 
                 0.2278 
                 0.5608 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train065 
                 2159 
                 0.3671 
                 0.5733 
                 RD 
                 Training 
                 PB 
               
               
                 Train066 
                 2160 
                 0.2556 
                 0.7211 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train018 
                 2167 
                 0.2668 
                 0.5404 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train034 
                 2168 
                 0.375 
                 0.5818 
                 RD 
                 Training 
                 PB 
               
               
                 Train044 
                 2189 
                 0.4933 
                 0.5293 
                 RD 
                 Training 
                 PB 
               
               
                 Train002 
                 2198 
                 0.2901 
                 0.7347 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train073 
                 2199 
                 0.239 
                 0.6261 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train096 
                 2214 
                 0.3876 
                 0.5346 
                 RD 
                 Training 
                 PB 
               
               
                 Train015 
                 2225 
                 0.3643 
                 0.6917 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train028 
                 2229 
                 0.2699 
                 0.5651 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train060 
                 2237 
                 0.2803 
                 0.6428 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train046 
                 2243 
                 0.354 
                 0.6155 
                 RD 
                 Training 
                 PB 
               
               
                 Train069 
                 2247 
                 0.2341 
                 0.5767 
                 RD 
                 Training 
                 PB 
               
               
                 Train091 
                 2250 
                 0.201 
                 0.6036 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train036 
                 2251 
                 0.2679 
                 0.723 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train021 
                 2271 
                 0.1904 
                 0.6088 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train025 
                 2272 
                 0.3232 
                 0.7678 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train095 
                 2281 
                 0.2205 
                 0.5 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train107 
                 2287 
                 0.1687 
                 0.6125 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train048 
                 2288 
                 0.4586 
                 0.8373 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train054 
                 2313 
                 0.2893 
                 0.6159 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train039 
                 2316 
                 0.4026 
                 0.5611 
                 RD 
                 Training 
                 PB 
               
               
                 Train029 
                 2319 
                 0.2573 
                 0.5793 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train086 
                 2320 
                 0.1875 
                 0.529 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train003 
                 2328 
                 0.176 
                 0.5864 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train092 
                 2336 
                 0.3631 
                 0.5713 
                 RD 
                 Training 
                 PB 
               
               
                 Train106 
                 2343 
                 0.2421 
                 0.5 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train100 
                 2350 
                 0.2636 
                 0.6528 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train059 
                 2353 
                 0.1693 
                 0.5614 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train077 
                 2358 
                 0.2381 
                 0.7286 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train099 
                 2362 
                 0.3188 
                 0.7348 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train075 
                 2364 
                 0.4784 
                 0.5111 
                 RD 
                 Training 
                 PB 
               
               
                 Train004 
                 2367 
                 0.3275 
                 0.5489 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train005 
                 2397 
                 0.3934 
                 0.6617 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train001 
                 2401 
                 0.0933 
                 0.7094 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train076 
                 2403 
                 0.0844 
                 0.6558 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train084 
                 2405 
                 0.2024 
                 0.6828 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train020 
                 2409 
                 0.4133 
                 0.5117 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train011 
                 2430 
                 0.235 
                 0.6275 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train072 
                 2438 
                 0.4769 
                 0.564 
                 RD 
                 Training 
                 PB 
               
               
                 Train027 
                 2440 
                 0.3462 
                 0.6174 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train108 
                 2450 
                 0.1605 
                 0.6474 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Train101 
                 2465 
                 0.1911 
                 0.6312 
                 CR/CRi 
                 Training 
                 PB 
               
               
                 Valid006 
                 2019 
                 0.443 
                 0.5937 
                 RD 
                 Validation 
                 BM 
               
               
                 Valid014 
                 2020 
                 0.3819 
                 0.5083 
                 RD 
                 Validation 
                 BM 
               
               
                 Valid028 
                 2050 
                 0.3367 
                 0.7264 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid018 
                 2086 
                 0.2781 
                 0.5227 
                 RD 
                 Validation 
                 BM 
               
               
                 Valid044 
                 2092 
                 0.4095 
                 0.5991 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid079 
                 2107 
                 0.4096 
                 0.6152 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid091 
                 2125 
                 0.2654 
                 0.6726 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid041 
                 2130 
                 0.0922 
                 0.6954 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid011 
                 2156 
                 0.2116 
                 0.5237 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid096 
                 2166 
                 0.4343 
                 0.5733 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid074 
                 2173 
                 0.3175 
                 0.5652 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid038 
                 2183 
                 0.2027 
                 0.6143 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid072 
                 2185 
                 0.4102 
                 0.5527 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid016 
                 2223 
                 0.2809 
                 0.7343 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid052 
                 2232 
                 0.3036 
                 0.5595 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid068 
                 2239 
                 0.3251 
                 0.6913 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid002 
                 2245 
                 0.4376 
                 0.5262 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid065 
                 2259 
                 0.2569 
                 0.5882 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid064 
                 2262 
                 0.2638 
                 0.7258 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid077 
                 2268 
                 0.4282 
                 0.522 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid060 
                 2270 
                 0.4299 
                 0.6019 
                 RD 
                 Validation 
                 BM 
               
               
                 Valid059 
                 2274 
                 0.3286 
                 0.6568 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid043 
                 2280 
                 0.3837 
                 0.5123 
                 RD 
                 Validation 
                 BM 
               
               
                 Valid037 
                 2314 
                 0.1769 
                 0.5768 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid067 
                 2324 
                 0.4404 
                 0.5751 
                 RD 
                 Validation 
                 BM 
               
               
                 Valid103 
                 2334 
                 0.2984 
                 0.5054 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid022 
                 2335 
                 0.3732 
                 0.5333 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid105 
                 2345 
                 0.3426 
                 0.7285 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid100 
                 2346 
                 0.2478 
                 0.5844 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid099 
                 2355 
                 0.3006 
                 0.723 
                 RD 
                 Validation 
                 BM 
               
               
                 Valid019 
                 2365 
                 0.242 
                 0.5678 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid005 
                 2369 
                 0.3539 
                 0.5103 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid012 
                 2371 
                 0.3835 
                 0.5474 
                 RD 
                 Validation 
                 BM 
               
               
                 Valid047 
                 2375 
                 0.396 
                 0.5673 
                 RD 
                 Validation 
                 BM 
               
               
                 Valid061 
                 2390 
                 0.439 
                 0.6215 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid055 
                 2417 
                 0.3571 
                 0.5704 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid075 
                 2436 
                 0.2666 
                 0.5534 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid057 
                 2445 
                 0.494 
                 0.6504 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid095 
                 2451 
                 0.2453 
                 0.65 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid104 
                 2456 
                 0.4589 
                 0.5847 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid004 
                 2458 
                 0.2937 
                 0.6751 
                 CR/CRi 
                 Validation 
                 BM 
               
               
                 Valid085 
                 2468 
                 0.3563 
                 0.603 
                 RD 
                 Validation 
                 BM 
               
               
                 Valid043 
                 2003 
                 0.3002 
                 0.5179 
                 RD 
                 Validation 
                 PB 
               
               
                 Valid091 
                 2005 
                 0.2449 
                 0.6101 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid038 
                 2008 
                 0.166 
                 0.5883 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid078 
                 2010 
                 0.3351 
                 0.5859 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid105 
                 2012 
                 0.3186 
                 0.8178 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid083 
                 2018 
                 0.19 
                 0.7275 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid103 
                 2026 
                 0.2588 
                 0.5643 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid085 
                 2033 
                 0.1647 
                 0.7138 
                 RD 
                 Validation 
                 PB 
               
               
                 Valid052 
                 2035 
                 0.2975 
                 0.5347 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid053 
                 2055 
                 0.2318 
                 0.641 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid005 
                 2071 
                 0.2313 
                 0.598 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid017 
                 2072 
                 0.3718 
                 0.5294 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid100 
                 2076 
                 0.1829 
                 0.5516 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid021 
                 2095 
                 0.3597 
                 0.6498 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid097 
                 2106 
                 0.2907 
                 0.6528 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid027 
                 2110 
                 0.4311 
                 0.496 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid004 
                 2118 
                 0.3641 
                 0.5267 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid079 
                 2127 
                 0.3789 
                 0.6551 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid068 
                 2133 
                 0.1896 
                 0.7814 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid066 
                 2138 
                 0.3451 
                 0.4578 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid075 
                 2144 
                 0.2268 
                 0.5412 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid006 
                 2146 
                 0.3852 
                 0.5711 
                 RD 
                 Validation 
                 PB 
               
               
                 Valid025 
                 2148 
                 0.3473 
                 0.6323 
                 RD 
                 Validation 
                 PB 
               
               
                 Valid104 
                 2161 
                 0.4367 
                 0.5416 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid011 
                 2162 
                 0.1732 
                 0.47 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid024 
                 2211 
                 0.2123 
                 0.6757 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid002 
                 2215 
                 0.4494 
                 0.5171 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid051 
                 2228 
                 0.1589 
                 0.6185 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid090 
                 2241 
                 0.2863 
                 0.7541 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid037 
                 2252 
                 0.2557 
                 0.5825 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid048 
                 2254 
                 0.4231 
                 0.6071 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid016 
                 2260 
                 0.2534 
                 0.682 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid081 
                 2263 
                 0.147 
                 0.5422 
                 RD 
                 Validation 
                 PB 
               
               
                 Valid020 
                 2301 
                 0.4719 
                 0.5943 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid063 
                 2323 
                 0.1645 
                 0.6196 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid034 
                 2327 
                 0.4049 
                 0.6079 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid069 
                 2331 
                 0.5397 
                 0.4809 
                 RD 
                 Validation 
                 PB 
               
               
                 Valid062 
                 2337 
                 0.102 
                 0.5543 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid013 
                 2339 
                 0.2891 
                 0.6239 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid010 
                 2342 
                 0.2766 
                 0.6008 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid059 
                 2363 
                 0.3279 
                 0.7122 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid018 
                 2383 
                 0.3423 
                 0.4994 
                 RD 
                 Validation 
                 PB 
               
               
                 Valid054 
                 2400 
                 0.3492 
                 0.6442 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid072 
                 2414 
                 0.4035 
                 0.5385 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid082 
                 2425 
                 0.2059 
                 0.5824 
                 RD 
                 Validation 
                 PB 
               
               
                 Valid032 
                 2427 
                 0.3397 
                 0.7973 
                 RD 
                 Validation 
                 PB 
               
               
                 Valid050 
                 2434 
                 0.4674 
                 0.5862 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid047 
                 2448 
                 0.4659 
                 0.6197 
                 RD 
                 Validation 
                 PB 
               
               
                 Valid023 
                 2452 
                 0.3091 
                 0.5181 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid056 
                 2453 
                 0.4577 
                 0.5756 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid058 
                 2460 
                 0.3604 
                 0.6285 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid102 
                 2467 
                 0.3836 
                 0.6289 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                 Valid019 
                 2469 
                 0.2264 
                 0.6034 
                 CR/CRi 
                 Validation 
                 PB 
               
               
                   
               
            
           
         
       
     
     MIFLOWCYT Summary for Example 1 
     1. List of Abbreviations and Definitions of Terms 
       
     
       
         
           
               
               
               
             
               
                   
                   
               
               
                   
                 Term 
                 Definition/Explanation 
               
               
                   
                   
               
             
            
               
                   
                 DMSO 
                 Dimethyl sulfoxide 
               
               
                   
                 ERF 
                 Equivalent Number of Reference Fluorophores 
               
               
                   
                 FACS buffer 
                 1X PBS + 0.5% BSA with 0.05% NaN3 
               
               
                   
                 FBS 
                 Fetal Bovine Serum 
               
               
                   
                 FCS 
                 Flow cytometry standard file 
               
               
                   
                 FSC 
                 Forward scatter 
               
               
                   
                 GDM-1 
                 AML cell line 
               
               
                   
                 MFI 
                 Mean fluorescence intensity 
               
               
                   
                 PBS 
                 Phosphate buffered saline 
               
               
                   
                 PBS + 0.1% NaN3 
                 High-Purity (filtered) Phosphate  
               
               
                   
                   
                 buffered saline + Sodium Azide 
               
               
                   
                 PFA 
                 Paraformaldehyde 
               
               
                   
                 RCP 
                 Rainbow calibration particles 
               
               
                   
                 RPMI 
                 RPMI 1640-tissue culture medium 
               
               
                   
                 RS4; 11 
                 ALL cell line. FLT3L responsive. 
               
               
                   
                 SCNP 
                 Single cell Network Profiling 
               
               
                   
                 SSC 
                 Side scatter 
               
               
                   
                 Thaw buffer 
                 RPMI media + 60% FBS 
               
               
                   
                 Wash buffer 
                 1X PBS + 0.5% BSA without 0.05% NaN3 
               
               
                   
                 WBC 
                 White blood cell count derived from the  
               
               
                   
                   
                 AcT10 hematology instrument 
               
               
                   
                 WinList 
                 Listmode analysis software used by  
               
               
                   
                   
                 Nodality (Verity Software House) 
               
               
                   
                   
               
            
           
         
       
     
     2. Experiment Overview 
     2.1 Purpose 
     To develop and validate a SCNP classifier (DX SCNP ) for the prediction of response to Ara-C-based induction chemotherapy using bone marrow (BM) and peripheral blood (PB) samples from elderly patients with newly diagnosed AML. 
     2.2 Keywords 
     SCNP, Single Cell Network Profiling, AML, Acute Myeloid Leukemia, multiparametric flow cytometry 
     2.3 Experiment Variables 
     Experiments were performed on cryopreserved peripheral blood (PB) and bone marrow (BM) AML samples collected as part of SWOG Studies SWOG-9031, SWOG-9333, S0112 or S0301 and ECOG Studies E3993 and E3999). The GDM1 and RS4; 11 cell lines served as positive controls for all assays performed. 
     Stained cells were acquired on standardized Becton Dickinson FACS Canto II flow cytometers. All reagents are specified below. 
     Refer to Experimental Details in Cesano, et al, for more details on experimental variables. 
     2.6 Dates During Which Study Was Conducted 
     The assay was conducted over a 9 week period with 2 batches per week and 28 samples per batch. A total of 435 samples (from 266 patients) were eligible for the study and were thawed, treated with modulators, stained, and analyzed using flow cytometry. All gating was performed manually using the WinList software package (Verity Software House, Topsham, Me.). 
     2.7 Conclusions 
     This study describes the training and validation of a classifier which uses inputs from multi-parametric analysis of intracellular signaling pathways to predict response to therapy in elderly AML patients. The results of this study confirm the ability of quantitative SCNP testing using functional flow cytometry to predict a clinical outcome such as induction response in elderly AML patients. 
     3. Instrument Details 
     3.1 Instrument Manufacturer 
     All flow cytometry data were collected on three Becton Dickinson FACS CANTO II cytometers. 
     
       
         
           
               
               
               
             
               
                   
               
               
                 Nodality 
                 Manufacturer  
                 Installation Date 
               
               
                 Asset Tag 
                 Serial Number 
                 (including filter sets) 
               
               
                   
               
             
            
               
                 00731 
                 V96300490 
                 Oct. 2, 2009 
               
               
                 00419 
                 V96300493 
                 Jul. 9, 2008 
               
               
                 00926 
                 V96300766 
                 Feb. 2, 2010 
               
               
                   
               
            
           
         
       
     
     3.2 Instrument Configuration and Settings 
     No alterations have been made to the flow cytometers with the exception of the following listed dichroic mirror/filter combinations. The optical paths are as shown in  FIG. 47 . 
     4. Reagents Used in the Experiment 
     4.1 Experimental Control Reagents 
     The following control cell lines and RCP were used in this study 
     
       
         
           
               
               
               
               
             
               
                   
                   
               
               
                   
                 Name 
                 Supplier 
                 Catalog No. 
               
               
                   
                   
               
             
            
               
                   
                 8 peak rainbow 
                 Spherotech Inc. 
                 RPC-30-5A 
               
               
                   
                 beads 
                   
                   
               
               
                   
                 GDM1 cell line 
                 ATCC 
                 TIB-2627 
               
               
                   
                 RS4; 11 cell line 
                 ATCC 
                 TIB-1873 
               
               
                   
                   
               
            
           
         
       
     
     4.2 Modulators 
     The table below provides a listing of vendor and catalog information for the modulators used in the study. Each modulator was qualified by identifying an intra-cellular readout and control sample/cell line that is expected to display induced signaling. The modulator was then titrated to identify optimal saturating concentration at which no further increasing in modulated signaling is observed. 
     
       
         
           
               
               
               
               
             
               
                   
                   
               
               
                   
                 Name 
                 Supplier 
                 Catalog Number 
               
               
                   
                   
               
             
            
               
                   
                 Ara C 
                 Sigma 
                 C1768 
               
               
                   
                 Cyclosporin A 
                 Calbiochem 
                 239835 
               
               
                   
                 Daunorubicin 
                 Sigma 
                 D8809 
               
               
                   
                 Etoposide 
                 Sigma 
                 E1383 
               
               
                   
                 FLT3L 
                 eBio 
                 14-8358-80 
               
               
                   
                 G-CSF 
                 R&amp;D Systems 
                 214-CS 
               
               
                   
                 IL-27 
                 R&amp;D Systems 
                 2526-IL 
               
               
                   
                 PMA 
                 Sigma 
                 P8139 
               
               
                   
                 SCF 
                 R&amp;D Systems 
                 255-SC 
               
               
                   
                 Thapsigargin 
                 Calbiochem 
                 586005 
               
               
                   
                   
               
            
           
         
       
     
     4.3 Antibodies 
     The following table provides vendor and catalog number information for each of the antibodies used in this study. Each of the lineage/gating marker antibodies was qualified by performing a serial titration of antibody concentrations using samples known to express cell subsets with positive and negative expression of the antibody. Similarly, each of the intra-cellular signaling antibodies was qualified by performing a titration using appropriate modulated and unmodulated control samples/cell lines (e.g. the p-S6 antibody was titrated against unmodulated as well as PMA modulated GDM-1 cells). The optimal antibody concentration was identified to maintain saturation and yield the optimal signal to noise ratio for gating antibodies or optimal evoked Log 2Fold response for signaling antibodies. 
     
       
         
           
               
            
               
                   
               
               
                 Antibody/Conjugate Supplier, Manufacturing,  
               
               
                 Testing and Specification Documents 
               
            
           
           
               
               
               
            
               
                 Name 
                 Supplier 
                 Catalog No. 
               
               
                   
               
               
                 CD117-APC 
                 DAKO 
                 C7244 
               
               
                 CD11b-PacBlue 
                 Nodality 
                 Original Supplier Catalog 
               
               
                   
                   
                 number; conjugated at Nodality 
               
               
                 CD135-PE 
                 BD Biosciences 
                 558996 
               
               
                 CD15-Biotin* 
                 BioLegend 
                 323016 
               
               
                 CD34-PE 
                 BD Biosciences 
                 348057 
               
               
                 CD34-PerCP 
                 BD Biosciences 
                 340666 
               
               
                 CD45-AF700 
                 Nodality 
                 Original Supplier Catalog 
               
               
                   
                   
                 number; conjugated at Nodality 
               
               
                 cPARP-FITC 
                 BD Biosciences 
                 558576 
               
               
                 cPARP-PacBlue 
                 Nodality 
                 Original Supplier Catalog 
               
               
                   
                   
                 number; conjugated at Nodality 
               
               
                 p-AKT-AF647 
                 CST 
                 2337 
               
               
                 p-CHK2-AF647 
                 CST 
                 2197 
               
               
                 p-CREB-PE 
                 BD Biosciences 
                 558436 
               
               
                 p-ERK1/2-AF647 
                 BD Biosciences 
                 612593 
               
               
                 p-ERK1/2-PE 
                 BD Biosciences 
                 612566 
               
               
                 p-S6-AF488 
                 BD Biosciences 
                 558438 
               
               
                 p-STAT1-AF488 
                 BD Biosciences 
                 612596 
               
               
                 p-STAT3-PE 
                 BD Biosciences 
                 612569 
               
               
                 p-STAT5-AF647 
                 BD Bioscience 
                 612599 
               
               
                   
               
            
           
         
       
     
     4.4 Summary of Modulators, Timing, and Cocktail Combinations 
     The table below shows the condition (combinations of modulator/inhibitor, modulation time, and the antibodies) in each well in which AML sample was plates. Following established SOPs at Nodality, the antibodies were combined into cocktails prior to starting of the experimental phase. Each cocktail, consisted of lineage or gating markers, common across multiple cocktails, as wells as intra-cellular signaling markers. 
     
       
         
           
               
               
               
               
               
               
               
            
               
                   
               
               
                   
               
               
                   
                   
                   
                 Duration 
                   
                   
                   
               
            
           
           
               
               
               
               
               
               
            
               
                   
                   
                 of 
                   
                   
                   
               
               
                   
                 Modulator 
                 Modulator 
                 Antibody 
                 Lineage &amp; gating 
                   
               
               
                 Modulator* 
                 Concentration 
                 treatment 
                 Cocktail 
                 markers 
                 Intracellular Readout 
               
               
                   
               
            
           
           
               
               
               
               
               
               
               
            
               
                 Pheno 
                   
                   
                 N/A 
                 AML-15 
                 CD38, CD135, CD15, 
                 None 
               
            
           
           
               
               
               
               
               
               
               
               
            
               
                   
                   
                   
                   
                   
                   
                 CD34, CD11b-, CD117, 
                   
               
               
                   
                   
                   
                   
                   
                   
                 CD45 
                   
               
               
                 AF 
                   
                   
                 15 
                 min 
                 AML-08 
                 AA, CD45, CD34 
                 None-AF background 
               
               
                 UM 
                   
                   
                 15  
                 min 
                 AML-14 
                 AA, CD45, CD34, cPARP 
                 p-Chk2, p21 
               
               
                 UM 
                   
                   
                 240 
                 min 
                 AML-14 
                 AA, CD45, CD34, cPARP 
                 p-Chk2, p21 
               
               
                 UM 
                   
                   
                 1440  
                 min 
                 AML-14 
                 AA, CD45, CD34, cPARP 
                 p-Chk2, p21 
               
               
                 Ara-C + 
                 500 
                 ng/mL 
                 1440  
                 min 
                 AML-14 
                 AA, CD45, CD34, cPARP 
                 p-Chk2, p21 
               
               
                 Daunorubicin 
                 100 
                 ng/mL 
                   
                   
                   
                   
                   
               
               
                 Ara-C + 
                 500 
                 ng/mL 
                 1440 
                 min 
                 AML-14 
                 AA, CD45, CD34, cPARP 
                 p-Chk2, p21 
               
               
                 Daunorubicin + 
                 100 
                 ng/mL 
                   
                   
                   
                   
                   
               
               
                 Cyclosporin A 
                 2.5 
                 μg/mL 
                   
                   
                   
                   
                   
               
               
                 UM 
                   
                   
                 15 
                 min 
                 AML-03 
                 AA, CD45, CD34, cPARP 
                 p-CREB, p-ERK, p-S6 
               
               
                 PMA 
                 400  
                 nM 
                 15 
                 min 
                 AML-03 
                 AA, CD45, CD34, cPARP 
                 p-CREB, p-ERK, p-S6 
               
               
                 UM 
                   
                   
                 15 
                 min 
                 AML-02 
                 AA, CD45, CD34, cPARP 
                 p-Akt, p-ERK, p-S6 
               
               
                 FLT3L 
                 50 
                 ng/mL 
                 15  
                 min 
                 AML-02 
                 AA, CD45, CD34, cPARP 
                 p-Akt, p-ERK, p-S6 
               
               
                 SCF 
                 20  
                 ng/mL 
                 15 
                 min 
                 AML-02 
                 AA, CD45, CD34, cPARP 
                 p-Akt, p-ERK, p-S6 
               
               
                 UM 
                   
                   
                 15 
                 min 
                 AML-01 
                 AA, CD45, CD34, cPARP 
                 p-Stat1, p-Stat3, p- 
               
               
                   
                   
                   
                   
                   
                   
                   
                 Stat5 
               
               
                 IL-27 
                 50  
                 ng/mL 
                 15 
                 min 
                 AML-01 
                 AA, CD45, CD34, cPARP 
                 p-Stat1, p-Stat3, p- 
               
               
                   
                   
                   
                   
                   
                   
                   
                 Stat5 
               
               
                 G-CSF 
                 50 
                 ng/mL 
                 15 
                 min 
                 AML-01 
                 AA, CD45, CD34, cPARP 
                 p-Stat1, p-Stat3, p- 
               
               
                   
                   
                   
                   
                   
                   
                   
                 Stat5 
               
               
                 AF 
                   
                   
                 1440  
                 min 
                 AML-11 
                 CD45, CD34 
                 None-AF background 
               
               
                 Etoposide 
                 30  
                 μg/mL 
                 1440 
                 min 
                 AML-14 
                 AA, CD45, CD34, cPARP 
                 p-Chk2, P21, cPARP 
               
               
                 Thapsigargin 
                 1  
                 μM 
                 15  
                 min 
                 AML-03 
                 AA, CD45, CD34, cPARP 
                 p-CREB, p-ERK, p-S6 
               
               
                   
               
               
                 *AF—autofluorescence; Pheno—phenotypic characterization cocktail; UM—unmodulated; 
               
            
           
         
       
     
     4.5 Plate Layouts 
     Samples were run in batches using 96-well plates. A total of 14 samples were processed per batch and two batches were performed on each experimental day. The plates corresponding to the functional readouts in signaling pathways included one row of cell line controls and 7 samples per plate as shown in  FIGS. 48A-48B , requiring two plates per batch. The apoptosis plates (4-hour and 24-hour,  FIGS. 48C-48D ) included one row of cell line controls and 14 donors per plate. 
     5. Quality Control Measures 
     Standard instrument controls (rainbow control particles, RCP) and cell line controls enabled the assessment of technical variability at the modulation, fixation, staining, and acquisition steps in the laboratory work flow thus allowing for the generation of reproducible results across operators, plates and time. These controls are essential in clinically applicable assays. 
     5.1.1 Rainbow Control Particles (RCP) 
     Intra- and inter-cytometer variance and longitudinal consistency of instrument performance were monitored by including a single lot of 8-peak RCP beads on each plate across the entire experiment. These RCPs are commercially available from Spherotech (Lake Forest, Ill.). RCPs were plated on the last column of each plate. The data from these beads is used to both monitor the performance of the cytometers as well as to calibrate the fluorescence intensity values for data from the remaining wells on the plates (equivalent reference fluorochrome, ERF, calculation). Data from these wells was first gated to identify the 8 distinct intensity peaks. The median fluorescence intensity (MFI) value for each peak in each channel was computed. The coefficient of variation (CV) for each peak and channel combination was computed across all the plates. 
     The table below shows the CVs for all the three instruments used in the study when calculated across the experiment (% CV) and also within each plate (% CV by Plate) and also by all the plates collected on a given acquisition date (% CV by Day). 
     
       
         
           
               
               
               
               
               
               
               
               
            
               
                   
               
               
                   
                   
                 V96300490 
                   
                 V96300493 
                   
                 V96300766 
                   
               
            
           
           
               
               
               
               
               
               
               
               
               
               
               
            
               
                   
                   
                   
                 % CV 
                   
                   
                 % CV 
                   
                   
                 % CV 
                   
               
               
                   
                   
                   
                 By 
                 % CV 
                 % 
                 By 
                 % CV 
                   
                 By 
                 % CV 
               
               
                 Channel 
                 Peak 
                 % CV 
                 Plate 
                 By Day 
                 CV 
                 Plate 
                 By Day 
                 % CV 
                 Plate 
                 By Day 
               
               
                   
               
            
           
           
               
               
               
               
               
               
               
               
               
               
               
            
               
                 FL1 
                 Peak1 
                 7.52 
                 4.63 
                 4.78 
                 8.81 
                 4.37 
                 4.65 
                 7.33 
                 4.44 
                 4.69 
               
               
                   
                 Peak2 
                 1.73 
                 0.96 
                 1.04 
                 1.57 
                 0.95 
                 1.01 
                 2.35 
                 1.12 
                 1.21 
               
               
                   
                 Peak3 
                 2.13 
                 0.99 
                 1.13 
                 1.53 
                 0.85 
                 0.93 
                 2.32 
                 1.18 
                 1.24 
               
               
                   
                 Peak4 
                 2.09 
                 0.96 
                 1.10 
                 1.50 
                 0.82 
                 0.89 
                 2.28 
                 1.19 
                 1.25 
               
               
                   
                 Peak5 
                 2.04 
                 0.95 
                 1.11 
                 1.51 
                 0.79 
                 0.87 
                 2.18 
                 1.17 
                 1.22 
               
               
                   
                 Peak6 
                 2.02 
                 0.94 
                 1.10 
                 1.54 
                 0.82 
                 0.91 
                 2.18 
                 1.18 
                 1.23 
               
               
                   
                 Peak7 
                 2.00 
                 0.95 
                 1.10 
                 1.51 
                 0.82 
                 0.90 
                 2.14 
                 1.18 
                 1.23 
               
               
                   
                 Peak8 
                 2.01 
                 0.95 
                 1.10 
                 1.44 
                 0.80 
                 0.88 
                 1.81 
                 1.12 
                 1.17 
               
               
                 FL2 
                 Peak1 
                 7.79 
                 6.63 
                 6.81 
                 8.11 
                 5.61 
                 5.78 
                 6.45 
                 5.41 
                 5.69 
               
               
                   
                 Peak2 
                 2.03 
                 1.00 
                 1.11 
                 1.65 
                 0.82 
                 0.92 
                 2.56 
                 1.18 
                 1.24 
               
               
                   
                 Peak3 
                 1.99 
                 0.94 
                 1.08 
                 1.53 
                 0.80 
                 0.88 
                 2.43 
                 1.20 
                 1.26 
               
               
                   
                 Peak4 
                 1.92 
                 0.95 
                 1.10 
                 1.54 
                 0.81 
                 0.90 
                 2.37 
                 1.20 
                 1.26 
               
               
                   
                 Peak5 
                 1.88 
                 0.95 
                 1.10 
                 1.54 
                 0.81 
                 0.90 
                 2.29 
                 1.19 
                 1.24 
               
               
                   
                 Peak6 
                 1.89 
                 0.95 
                 1.10 
                 1.56 
                 0.83 
                 0.93 
                 2.31 
                 1.20 
                 1.25 
               
               
                   
                 Peak7 
                 1.85 
                 0.95 
                 1.10 
                 1.54 
                 0.84 
                 0.93 
                 2.25 
                 1.18 
                 1.24 
               
               
                   
                 Peak8 
                 1.38 
                 0.81 
                 0.93 
                 1.10 
                 0.70 
                 0.77 
                 1.67 
                 1.06 
                 1.10 
               
               
                 FL3 
                 Peak1 
                 8.53 
                 6.87 
                 7.24 
                 10.48 
                 6.71 
                 6.97 
                 8.12 
                 6.53 
                 6.94 
               
               
                   
                 Peak2 
                 2.04 
                 1.04 
                 1.19 
                 1.78 
                 0.99 
                 1.07 
                 2.70 
                 1.20 
                 1.27 
               
               
                   
                 Peak3 
                 1.97 
                 0.96 
                 1.10 
                 1.51 
                 0.82 
                 0.92 
                 2.60 
                 1.20 
                 1.25 
               
               
                   
                 Peak4 
                 1.94 
                 0.95 
                 1.10 
                 1.50 
                 0.81 
                 0.90 
                 2.55 
                 1.20 
                 1.26 
               
               
                   
                 Peak5 
                 1.88 
                 0.94 
                 1.10 
                 1.50 
                 0.80 
                 0.89 
                 2.47 
                 1.20 
                 1.25 
               
               
                   
                 Peak6 
                 1.86 
                 0.94 
                 1.09 
                 1.53 
                 0.83 
                 0.93 
                 2.46 
                 1.20 
                 1.25 
               
               
                   
                 Peak7 
                 1.78 
                 0.93 
                 1.08 
                 1.51 
                 0.83 
                 0.92 
                 2.37 
                 1.18 
                 1.23 
               
               
                   
                 Peak8 
                 1.28 
                 0.78 
                 0.91 
                 1.09 
                 0.69 
                 0.77 
                 1.73 
                 1.05 
                 1.09 
               
               
                 FL4 
                 Peak1 
                 9.75 
                 7.92 
                 8.24 
                 9.74 
                 6.71 
                 6.94 
                 8.75 
                 6.96 
                 7.21 
               
               
                   
                 Peak2 
                 2.40 
                 1.45 
                 1.54 
                 2.01 
                 1.18 
                 1.23 
                 2.93 
                 1.39 
                 1.47 
               
               
                   
                 Peak3 
                 2.11 
                 1.12 
                 1.24 
                 1.52 
                 0.88 
                 0.95 
                 2.59 
                 1.23 
                 1.29 
               
               
                   
                 Peak4 
                 2.05 
                 1.06 
                 1.20 
                 1.50 
                 0.82 
                 0.90 
                 2.54 
                 1.23 
                 1.28 
               
               
                   
                 Peak5 
                 1.96 
                 1.00 
                 1.13 
                 1.51 
                 0.80 
                 0.88 
                 2.48 
                 1.19 
                 1.24 
               
               
                   
                 Peak6 
                 1.96 
                 1.02 
                 1.15 
                 1.53 
                 0.82 
                 0.90 
                 2.49 
                 1.21 
                 1.26 
               
               
                   
                 Peak7 
                 1.86 
                 0.99 
                 1.12 
                 1.53 
                 0.81 
                 0.89 
                 2.38 
                 1.18 
                 1.23 
               
               
                   
                 Peak8 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
               
               
                 FL5 
                 Peak1 
                 1.39 
                 0.97 
                 1.02 
                 1.61 
                 0.90 
                 0.95 
                 2.09 
                 1.24 
                 1.32 
               
               
                   
                 Peak2 
                 1.44 
                 0.89 
                 0.97 
                 1.73 
                 0.75 
                 0.80 
                 2.23 
                 1.21 
                 1.31 
               
               
                   
                 Peak3 
                 1.51 
                 0.91 
                 1.00 
                 1.71 
                 0.79 
                 0.85 
                 2.14 
                 1.23 
                 1.33 
               
               
                   
                 Peak4 
                 1.53 
                 0.92 
                 1.01 
                 1.73 
                 0.80 
                 0.87 
                 2.16 
                 1.27 
                 1.36 
               
               
                   
                 Peak5 
                 1.53 
                 0.91 
                 1.00 
                 1.73 
                 0.79 
                 0.86 
                 2.09 
                 1.24 
                 1.34 
               
               
                   
                 Peak6 
                 1.55 
                 0.92 
                 1.01 
                 1.75 
                 0.82 
                 0.89 
                 2.16 
                 1.26 
                 1.36 
               
               
                   
                 Peak7 
                 1.50 
                 0.90 
                 0.99 
                 1.71 
                 0.82 
                 0.88 
                 2.10 
                 1.24 
                 1.33 
               
               
                   
                 Peak8 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
               
               
                 FL6 
                 Peak1 
                 1.54 
                 1.05 
                 1.13 
                 1.83 
                 1.02 
                 1.10 
                 2.23 
                 1.31 
                 1.41 
               
               
                   
                 Peak2 
                 1.46 
                 0.95 
                 1.03 
                 1.88 
                 0.84 
                 0.90 
                 2.28 
                 1.22 
                 1.32 
               
               
                   
                 Peak3 
                 1.52 
                 0.94 
                 1.03 
                 1.84 
                 0.81 
                 0.87 
                 2.17 
                 1.19 
                 1.30 
               
               
                   
                 Peak4 
                 1.57 
                 0.95 
                 1.06 
                 1.86 
                 0.82 
                 0.88 
                 2.17 
                 1.24 
                 1.35 
               
               
                   
                 Peak5 
                 1.57 
                 0.92 
                 1.03 
                 1.85 
                 0.80 
                 0.86 
                 2.11 
                 1.22 
                 1.34 
               
               
                   
                 Peak6 
                 1.60 
                 0.95 
                 1.05 
                 1.87 
                 0.82 
                 0.89 
                 2.16 
                 1.25 
                 1.36 
               
               
                   
                 Peak7 
                 1.53 
                 0.92 
                 1.01 
                 1.85 
                 0.81 
                 0.87 
                 2.10 
                 1.22 
                 1.33 
               
               
                   
                 Peak8 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.65 
                 0.48 
                 0.50 
               
               
                 FL7 
                 Peak1 
                 1.42 
                 1.01 
                 1.15 
                 1.62 
                 1.20 
                 1.31 
                 1.81 
                 1.37 
                 1.45 
               
               
                   
                 Peak2 
                 1.34 
                 0.92 
                 1.02 
                 1.37 
                 0.81 
                 0.87 
                 1.95 
                 1.21 
                 1.27 
               
               
                   
                 Peak3 
                 1.46 
                 0.98 
                 1.08 
                 1.34 
                 0.81 
                 0.89 
                 2.00 
                 1.30 
                 1.37 
               
               
                   
                 Peak4 
                 1.50 
                 1.00 
                 1.10 
                 1.35 
                 0.80 
                 0.89 
                 2.01 
                 1.29 
                 1.36 
               
               
                   
                 Peak5 
                 1.44 
                 0.94 
                 1.04 
                 1.36 
                 0.79 
                 0.88 
                 2.00 
                 1.26 
                 1.34 
               
               
                   
                 Peak6 
                 1.46 
                 0.95 
                 1.05 
                 1.36 
                 0.79 
                 0.88 
                 2.00 
                 1.26 
                 1.34 
               
               
                   
                 Peak7 
                 1.45 
                 0.88 
                 1.00 
                 1.40 
                 0.77 
                 0.85 
                 2.03 
                 1.23 
                 1.34 
               
               
                   
                 Peak8 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.00 
                 0.36 
                 0.28 
                 0.29 
               
               
                 FL8 
                 Peak1 
                 4.33 
                 3.15 
                 3.39 
                 5.33 
                 3.77 
                 3.92 
                 3.04 
                 2.57 
                 2.76 
               
               
                   
                 Peak2 
                 1.49 
                 1.00 
                 1.10 
                 1.61 
                 0.92 
                 1.01 
                 2.00 
                 1.21 
                 1.27 
               
               
                   
                 Peak3 
                 1.54 
                 0.99 
                 1.09 
                 1.41 
                 0.80 
                 0.88 
                 2.03 
                 1.29 
                 1.35 
               
               
                   
                 Peak4 
                 1.60 
                 1.01 
                 1.11 
                 1.41 
                 0.79 
                 0.87 
                 2.06 
                 1.31 
                 1.36 
               
               
                   
                 Peak5 
                 1.52 
                 0.94 
                 1.04 
                 1.42 
                 0.79 
                 0.87 
                 2.04 
                 1.27 
                 1.32 
               
               
                   
                 Peak6 
                 1.52 
                 0.93 
                 1.02 
                 1.41 
                 0.77 
                 0.85 
                 2.03 
                 1.25 
                 1.31 
               
               
                   
                 Peak7 
                 1.44 
                 0.85 
                 0.96 
                 1.42 
                 0.75 
                 0.83 
                 2.04 
                 1.21 
                 1.26 
               
               
                   
                 Peak8 
                 1.51 
                 0.90 
                 1.01 
                 1.40 
                 0.76 
                 0.86 
                 2.03 
                 1.28 
                 1.34 
               
               
                   
               
            
           
         
       
     
     Additionally, all cytometers are qualified each day before use according to the manufacturer&#39;s suggested quality control program as well as a more stringent internally developed quality control program documented in approved SOPs and performance specifications. Cytometers performing outside established performance specifications were taken off-line, corrective actions taken and documented and the instrument then verified prior to bringing back on-line for use. 
     5.1.2 Cell Lines 
     Overall assay performance was monitored by running GDM1 and RS4;11 cell lines on every plate. Original cell lines were obtained from American Type Culture Collection (ATCC; Manassas, Va.). A single batch of these cell lines were expanded in culture, cryopreserved, quality control tested and released following performance verification according to approved SOPs and appropriate release specifications. 
     The table below highlights the overall % CVs of modulated signaling, measured by U, metric, e for the cell lines during the course of the entire experiment across all cytometers and all dates of acquisition. 
     
       
         
           
               
               
               
               
               
               
             
               
                   
               
               
                   
                   
                   
                   
                 % CV 
                 %CV 
               
               
                   
                 ModTime 
                   
                   
                 for 
                 for 
               
               
                 Modulator 
                 (Min) 
                 Stain 
                 Color 
                 GDM-1 
                 RS4; 11 
               
               
                   
               
             
            
               
                   
               
            
           
           
               
               
               
               
               
               
            
               
                 AraC + Duano 
                 1440 
                 cPARP 
                 Violet_B-A 
                 2.811 
                 3.246 
               
               
                 AraC + Duano 
                 1440 
                 p-Chk2 
                 Red_C-A 
                 4.855 
                 3.932 
               
               
                 Etoposide 
                 1440 
                 cPARP 
                 Violet_B-A 
                 4.034 
                 0.979 
               
               
                 Etoposide 
                 1440 
                 p-Chk2 
                 Red_C-A 
                 5.495 
                 4.141 
               
               
                 FLT3L 
                 15 
                 p-Akt 
                 Red_C-A 
                 4.210 
                 2.728 
               
               
                 FLT3L 
                 15 
                 p-Erk 
                 Blue_D-A 
                 7.256 
                 6.669 
               
               
                 FLT3L 
                 15 
                 p-S6 
                 Blue_E-A 
                 3.113 
                 3.398 
               
               
                 G-CSF 
                 15 
                 p-Stat1 
                 Blue_E-A 
                 4.805 
                 7.176 
               
               
                 G-CSF 
                 15 
                 p-Stat3 
                 Blue_D-A 
                 5.990 
                 5.071 
               
               
                 G-CSF 
                 15 
                 p-Stat5 
                 Red_C-A 
                 5.367 
                 4.723 
               
               
                 IL-27 
                 15 
                 p-Stat1 
                 Blue_E-A 
                 3.466 
                 4.892 
               
               
                 IL-27 
                 15 
                 p-Stat3 
                 Blue_D-A 
                 4.796 
                 4.654 
               
               
                 IL-27 
                 15 
                 p-Stat5 
                 Red_C-A 
                 5.779 
                 5.036 
               
               
                 PMA 
                 15 
                 p-CREB 
                 Blue_D-A 
                 1.473 
                 2.788 
               
               
                 PMA 
                 15 
                 p-Erk 
                 Red_C-A 
                 2.102 
                 1.176 
               
               
                 PMA 
                 15 
                 p-S6 
                 Blue_E-A 
                 2.458 
                 3.019 
               
               
                 SCF 
                 15 
                 p-Akt 
                 Red_C-A 
                 4.716 
                 8.642 
               
               
                 SCF 
                 15 
                 p-Erk 
                 Blue_D-A 
                 14.036 
                 18.699 
               
               
                 SCF 
                 15 
                 p-S6 
                 Blue_E-A 
                 3.909 
                 8.400 
               
               
                 Thapsigargin 
                 15 
                 p-CREB 
                 Blue_D-A 
                 4.018 
                 4.845 
               
               
                 Thapsigargin 
                 15 
                 p-Erk 
                 Red_C-A 
                 5.143 
                 5.382 
               
               
                 Thapsigargin 
                 15 
                 p-S6 
                 Blue_E-A 
                 3.583 
                 7.265 
               
               
                   
               
            
           
         
       
     
     Using these two levels of controls (RCP for cytometer performance and cell lines control for assay performance) the majority (28/44) of the functional assay readout CVs were less than 5% and most of them (42/44) were less than 10% as expected across all days and batches for the study. 
     6. Flow Sample/Specimen Details 
     6.1 Sample/Specimen Material Description 
     Refer to the Example for all details on the clinical samples used in this study. Pre-specified evaluability criteria are described in the Supplemental methods Section 1.1. 
     6.2 Sample Treatment(s) Description 
     Refer to the Example for details on the experiment. 
     Cryopreserved samples were processed in batches. Upon thaw, cells underwent a Ficoll-Hypaque gradient purification. The samples were plated into 96-well plates (75,000 cells/well) (see Figure below for an example plate layout) and then incubated with modulators, fixed, and permeabilized as previously described for the SCNP assay (Kornblau, et al. Clin Cancer Res 2010; Cesano, Spellmeyer Methods Mol Biol, 2014; Cesano, et al., Cytometry B, 2012). The samples were then incubated with a cocktail of fluorochrome-conjugated antibodies that recognize extracellular lineage markers and intracellular epitopes including phospho-epitopes within intracellular signaling molecules. 
     7. Data Analysis Details 
     7.1 List-mode Data File 
     Single cell data were then acquired on one of three BD FACS CANTO II flow cytometer and the raw flow cytometry data files (called FCS files) were deposited on the File server for later analysis. The FCS files contain all events (including debris, cells, etc.) collected from the cytometer from each well acquired separated into individual files. 
     7.2 Compensation Details 
     Flow cytometers are maintained through a daily QC program to monitor fluorescence, PMT voltages, and compensation allowing multiple instruments and platforms to be utilized if required (see reference 12 in manuscript for description of standardized “window of analysis”). For the experiments performed within this study, PMT voltages were set based upon a standard instrument setup QC procedure and compensation values for each pure dye reagent were established and monitored within this QC program. 
     All compensation is performed computationally after data acquisition. 
     7.3 Gating (Data Filtering) Details 
     The populations of interest are 1) “P1” which describes the leukemic cell population and 2) “Healthy P1” which describes the healthy cells within the P1 population. 
     7.3.1 Gate Description 
     The gating definitions for P1 and Healthy P1 and CD34+ are as follows and as highlighted in  FIGS. 49A-49B . 
     7.3.1.1 P1 Gate 
     These are cells that are defined to be nucleated by light scatter (Region R1) but excluding all high SSC granulocytic forms (i.e., progranulocytes, metamyelocytes and myelocytes), are negative for amine aqua staining (Region R9), are CD45+ and express the SSC vs. CD45 characteristics of myeloid blasts and monocytoid cells (Region R3). The R3 gate will not include erythroid or progranulocytic cells. The Boolean equation used in WinList to derive these values is defined as: P1=(R1&amp;R3&amp;R9) 
     7.3.1.2 Healthy P1 gate 
     This gate captures the leukemic cells not undergoing apoptosis (cPARP negative or “healthy”). Each well contains an antibody against cPARP which will be used to determine the percentage of healthy cells in the P1 gate in each well. For each sample autofluorescence (AF) P1 values from the unmodulated 15′ timepoint wells will be used to compute a 98th percentile AF cutoff for that sample. cPARP staining in the other wells containing the same sample will use this cutoff to classify P1 events as cPARP positive (apoptotic P1) or cPARP negative (Healthy P1) cells. 
     7.4 Data Transformation Details and SCNP Metrics 
     Specific metrics were developed to describe and quantify the functional changes observed using the SCNP assay. 
     Median Fluorescence Intensity (MFI): 
     MFI was computed from the fluorescence intensity levels of the cells. 
     Equivalent Number of Reference Fluorophores (ERF) Metric: 
     ERF a transformed value of the MFI values, was computed using a calibration line determined by fitting observations of a standardized set of 8-peak rainbow bead control particles for all fluorescent channels to standard values assigned by the manufacturer. ERF was used to standardize, qualify and monitor the instrument during setup, and to calibrate the raw fluorescence intensity readouts on a plate-by-plate basis and to control for instrument variability. 
     ERF values were then used to compute a variety of metrics to measure the biology of functional signaling proteins (see  FIG. 46 ). In the metric definitions that follow a=autofluorescence, u=unmodulated, and m=modulated. 
     Log 2Fold Change is defined as: 
     
       
         
           
             
               
                 log 
                 2 
               
                
               Fold 
             
             = 
             
               
                 log 
                 2 
               
                
               
                 [ 
                 
                   
                     ERF 
                     modulated 
                   
                   
                     ERF 
                     unmodulated 
                   
                 
                 ] 
               
             
           
         
       
     
     Uu Metric: 
     Computed as the Mann-Whitney U statistic comparing the intensity values for an antibody in the modulated and unmodulated wells that has been scaled to the unit interval (0.1) for a given cell population for a sample. 
     Percent Healthy Metric: P h   Intact    
     Percentage of leukemic blast cells that is negative for cPARP expression. The 98th percentile value for autofluorescence was used to determine the positive-negative split point. 
     While preferred embodiments of the present invention have been shown and described herein, it will be obvious to those skilled in the art that such embodiments are provided by way of example only. Numerous variations, changes, and substitutions will now occur to those skilled in the art without departing from the invention. It should be understood that various alternatives to the embodiments described herein described herein may be employed in practicing the invention. It is intended that the following claims define the scope described herein and that methods and structures within the scope of these claims and their equivalents be covered thereby.