- Why it surfaces
- A boundary stated once but not echoed near the claim it bounds is easy to miss on a single read.
- Consider
- Add a one-clause reminder scoping the conclusion.
Manuscript
Polarization metrics in online discourse
Quantitative · Q1 target · Author mode
Integrated risk posture
HIGH
Risk concentrates around untested metric assumptions, disagreement described as convergence, and absent data and code availability.
5critical
6major
4minor
Author Mode
Plain-language findings
This version explains what surfaced, why a reviewer may notice it, and what you could consider before submission. It is not a verdict.
2 · Theoretical frameworkMEDIUM
Each metric's core assumption is defined in a separate subsection instead of compared directly.
- Why it surfaces
- Distributed assumptions make it hard to see where the three constructs actually diverge.
- Consider
- Consolidate into one comparison table.
3 · Methodological visibilityCRITICAL
A load-bearing assumption for the network-based metric is declared but never checked against the dataset.
- Why it surfaces
- A prerequisite assumption that's stated but untested is one of the first things a careful read looks for.
- Consider
- Report a graph-stability statistic for the sampling window.
3 · Methodological visibilityMEDIUM
A fixed activity-rate cutoff for bot filtering has no stated basis.
- Why it surfaces
- Without a stated basis, a reader can't tell if the threshold is conservative, liberal, or tuned to the data.
- Consider
- Connect the threshold to a cited bot-detection benchmark.
3 · Methodological visibilityLOW
The four-month sampling window isn't connected to a seasonal or event-driven rationale.
- Why it surfaces
- A window choice without stated rationale leaves a reader unable to judge representativeness.
4 · ArgumentationCRITICAL
Three polarization scores disagree, and the text describes this as convergence.
- Why it surfaces
- When a paper's own numbers show disagreement but the prose says convergence, the two need reconciling. Right now no criterion is offered.
- Consider
- State an explicit convergence criterion and address the outlier directly.
4 · ArgumentationMEDIUM
A convergence claim leads the sentence while its largest exception follows as an afterthought.
- Why it surfaces
- The rhetorical structure makes the exception sound secondary, while the numbers make it primary.
- Consider
- State the divergence and its size directly alongside the claim.
5 · Numerical behaviorMEDIUM
Confidence interval conventions change across tables with no single governing statement.
- Why it surfaces
- A reader cross-referencing values across tables has to first figure out if the conventions are even comparable.
- Consider
- Define one interval convention in methods.
6 · Language & hedgingMEDIUM
An unhedged convergence claim sits beside the paper's largest internal disagreement.
- Why it surfaces
- This is the one major claim left unhedged, despite sitting directly beside the biggest outlier in the comparison.
- Consider
- Hedge the claim or state the exception within the same sentence.
7 · Structural integrityLOW
A policy-relevant claim in the abstract is separated from the reasoning that supports it.
- Why it surfaces
- An abstract-only reader receives a claim without its supporting evidence.
- Consider
- Add a brief signpost to where the reasoning appears.
8 · Limits & uncertaintiesCRITICAL
A single-platform, single-window dataset is not carried into the conclusion as an explicit boundary.
- Why it surfaces
- Generalizability beyond the studied platform is undeclared despite an acknowledged mid-window confound. Cross-platform inference can't be supported from this data.
- Consider
- State the platform-specific boundary directly in the conclusion.
8 · Limits & uncertaintiesLOW
A named confound from a mid-window platform change is never given an estimated effect size.
- Why it surfaces
- A factor identified as a likely confound but left unquantified limits how the result can be interpreted.
9 · Figure / table integrityMEDIUM
A visual element central to the combined indicator is never defined.
- Why it surfaces
- The shaded region is exactly where a reader would look to judge the indicator's uncertainty, but it carries no stated definition.
- Consider
- Define the region and its relationship to the reported scores.
10 · ReproducibilityCRITICAL
No data availability statement is present anywhere in the manuscript.
- Why it surfaces
- For a study whose contribution is the metric comparison itself, this removes one of two paths to independent verification.
- Consider
- Add a data availability statement consistent with platform terms.
10 · ReproducibilityCRITICAL
No code availability statement is present for any of the three metric implementations.
- Why it surfaces
- Combined with absent data, this removes both routes for independently checking the comparison.
- Consider
- Link a repository or state a release timeline.