Skip to main content

Table 3 Comparison of linear model fit between target and non-target genera

From: Modeling the limits of detection for antimicrobial resistance genes in agri-food samples: a comparative analysis of bioinformatics tools

Target genusa

Non-target genusb

Model equationc

p-valued

Enterococcus ŷ = 4.03 + 1.00x

Bacillus

ŷ = 0.276 + 1.07x

p > 0.997

Staphylococcus

ŷ = 1.11 + 1.26x

p > 0.051

Salmonella

ŷ = -0.304 + 1.02x

p > 0.999

Escherichia ŷ = 4.09 + 1.00x

Citrobacter

ŷ = 1.48 + 0.928x

p > 0.848

Enterobacter

ŷ = 1.39 + 0.999x

p = 1.0

Klebsiella

ŷ = 1.46 + 0.967x

p > 0.999

Salmonella

ŷ = 1.05 + 1.01x

p = 1.0

Shigella

ŷ = 1.34 + 1.06x

p > 0.931

Klebsiella ŷ = 4.22 + 0.999x

Citrobacter

ŷ = 1.22 + 1.06x

p > 0.988

Enterobacter

ŷ = 1.74 + 0.995x

p = 1.0

Escherichia

ŷ = 1.6 + 1.06x

p > 0.993

Listeria ŷ = 4 + 1.00x

Bacillus

ŷ = 1.07 + 1.09x

p > 0.595

Enterococcus

ŷ = 0.543 + 1.16x

p < 0.024 *

Staphylococcus

ŷ = 0.457 + 1.17x

p < 0.016 *

Salmonella ŷ = 4.18 + 1.00x

Citrobacter

ŷ = 0.584 + 1.17x

p > 0.282

Enterobacter

ŷ = 0.22 + 1.02x

p > 0.999

Escherichia

ŷ = 1.96 + 1.01x

p > 0.999

Klebsiella

ŷ = 0.683 + 1.03x

p > 0.999

  1. *Results for Listeria versus Enterococcus and Staphylococcus were slightly significant, but are still displayed
  2. aEquation for the linear log–log model for relationship between coverage level and operational taxonomic units is below each genus
  3. bFor each genus in the first column, only non-target genera with interesting (non-significant) results are listed
  4. cEquation for the log–log linear model fit to the relationship between coverage level and assigned operational taxonomic units for corresponding non-target genus
  5. dp-value following statistical comparison of slopes between target genus and non-target genus. Non-significant results are displayed (p > 0.05); p < 0.05 = *