To be fair, journal articles and scientific research in general have gotten to be pretty bullshit. Haven’t they studied this and proven the vast majority of published journal papers probably shouldn’t have been?
A couple easily Google examples of discussion regarding scientific publications likely being bullshit.
I saw a clip on how kids out of uni don’t believe anything not peer reviewed; even intuitive observations in nature that otherwise undocumented or site specific observations that went against the grain.
Science is a way of thinking and observing, rather than papers, but papers are a good way to refine your thinking
In theory, a paper gives you a methodology that you can use to reproduce the findings. And a refusal to use papers to repeat findings (because shit costs money and nobody wants to publish iterative studies) means you end up with a bunch of novel findings that are never confirmed through repetition.
But the fact that nobody is bothering to repeat these studies also raises a question of what exactly is being researched. Certainly, the more useful scientific research efforts are about formulating applicable techniques. So they would need to be reproducible to have any functional value.
The fact that we’re not seeking to replicate studies suggests that we’re investing a ton of time in niche under-utilized fields. And that may be a problem of investigative research (we’re so focused on publishing that we don’t care what we’re actually studying) or a problem of applied sciences (we’re so focused on scaling up older methods to industrial scale that we’re leaving better methods of production on the cutting room floor).
TBF I’ve lost count of the number of times someone has cited some paper as a reference for the point they are trying to make and when I inspect the paper it has shitty “n”, the paper is written for an agenda (not sure what that’s called where I.e. a paper saying smoking is good for you/not harmful is paid for by the tobacco industry and written by tobacco industry scientists), or it might even just be straight up bullshit written to look like a legit paper.
Peer Review at least offers some barriers to the problems with papers, but it’s definitely not a panacea.
I’m guessing not all hypotheses receive the same interest or funding to begin with. Definitely seems to be a selection bias on what actually gets funded/studied. Even worse, when they withhold results they don’t like from being published.
To be fair, journal articles and scientific research in general have gotten to be pretty bullshit. Haven’t they studied this and proven the vast majority of published journal papers probably shouldn’t have been?
A couple easily Google examples of discussion regarding scientific publications likely being bullshit.
Why Most Published Research Findings Are False
Surge in number of ‘extremely productive’ authors concerns scientists
Too much academic research is being published
More than 10,000 research papers were retracted in 2023 — a new record
Whistleblowers flagged 300 scientific papers for retraction. Many journals ghosted them
Top 10 most highly cited retracted papers
And on and on. Publish or perish and general shitty culture in academia is why I quit phd and took my masters and left.
I saw a clip on how kids out of uni don’t believe anything not peer reviewed; even intuitive observations in nature that otherwise undocumented or site specific observations that went against the grain.
Science is a way of thinking and observing, rather than papers, but papers are a good way to refine your thinking
In theory, a paper gives you a methodology that you can use to reproduce the findings. And a refusal to use papers to repeat findings (because shit costs money and nobody wants to publish iterative studies) means you end up with a bunch of novel findings that are never confirmed through repetition.
But the fact that nobody is bothering to repeat these studies also raises a question of what exactly is being researched. Certainly, the more useful scientific research efforts are about formulating applicable techniques. So they would need to be reproducible to have any functional value.
The fact that we’re not seeking to replicate studies suggests that we’re investing a ton of time in niche under-utilized fields. And that may be a problem of investigative research (we’re so focused on publishing that we don’t care what we’re actually studying) or a problem of applied sciences (we’re so focused on scaling up older methods to industrial scale that we’re leaving better methods of production on the cutting room floor).
But its definitely some kind of problem.
TBF I’ve lost count of the number of times someone has cited some paper as a reference for the point they are trying to make and when I inspect the paper it has shitty “n”, the paper is written for an agenda (not sure what that’s called where I.e. a paper saying smoking is good for you/not harmful is paid for by the tobacco industry and written by tobacco industry scientists), or it might even just be straight up bullshit written to look like a legit paper.
Peer Review at least offers some barriers to the problems with papers, but it’s definitely not a panacea.
The problem is without peer reviewed papers it’s hard to credit that someone all the way around the world observed something.
In a perfect world nobody is lying and everyone has the scientific base education to understand how to report phenomena properly. But uhhh… Yeah.
I’m guessing not all hypotheses receive the same interest or funding to begin with. Definitely seems to be a selection bias on what actually gets funded/studied. Even worse, when they withhold results they don’t like from being published.