How can you tell an Expert from a non-Expert?

Horatius

NWO Kitty Wrangler
Joined
May 9, 2006
Messages
29,691
I’ve excerpted a few comments from this thread to introduce a new meta-topic. Take a look, and then meet me down the page.


I like how CTers demand a professional analysis... and yet when I (a professional) offer my analysis, they dismiss it out of hand.

The engineers at Skywalker Sound could produce a 500 page analysis that demonstrates it is false and the CTers would still dismiss it.

-Gumboot

Because you're about as skeptical as a baby with a tit in its mouth.
Cut the crap.

Hit a nerve did I Scooby? Perhaps you'd like to present your expert analysis of the video? That is, assuming you actually have any expertise.

-Gumboot

You have not presented any expert analysis. You aren't even an expert in the faking of videos.

You don't even know who I am...

-Gumboot

Exactly my point.

So you want an expert in faking videos? As in an expert in making a video that is not say like a news cameraman or editor but say something like a hollywood cameraman?

The information I am presenting is not reliant on my identity. Regardless of if I am a forensic sound analyst for the NSA (I'm not) or a corn farmer (I'm not) the features described in this video continue to be in this video. I am merely identifying them.

Albert Einstein himself could claim that 9/11 was an inside job, and the evidence would still prove him wrong.

-Gumboot


This raises a question we’ve dealt with here before, but never explicitly. That is, how can we determine, solely on the basis of their postings, how competent a particular poster is in the area of expertise they claim? We have a list of peoples’ alleged areas of expertise, but how do we know they are for real?

There was another thread on “Looking for Truth in Credentials”, which quickly devolved into the usual back-and-forth on science and evidence. I’m hoping this thread will avoid that, and address a more fundamental issue, not necessarily applied to 9/11 or CTs, although my examples will almost all be from this forum.

As a start, I’ll mention two complementary aspects of a person’s knowledge, which leads me to accept them as being an expert (or at least, well educated) on the topics they discuss: Broad knowledge, and detailed knowledge. That is, knowing a lot about varied aspects of the topic, while also being able to go into detail on a specific aspect. Compare the discussions of Truthseeker1234 and R.Mackey. A typical TS1234 post:

http://www.internationalskeptics.com/forums/showthread.php?postid=2423529#post2423529


Compared to R.Mackey:

http://www.internationalskeptics.com/forums/showthread.php?postid=2430207#post2430207

TS1234 posts a lot of vague generalities; misusing terms, and supports his whole thesis with a video and a photo. R.Mackey provided a fairly comprehensive run-down of all the relevant topics, cites his sources, and uses terms precisely. Just on this basis alone, it’s clear to me that R.Mackey is simply more knowledgeable on the subject, and if you trust his honesty, you can trust his conclusions. No so much for TS1234, though.

There are other examples of this, which I’ll likely post later, but I thought I’d see what others think of this question. What is it about a poster that leads you to accept the legitimacy of their expertise?
 
Generally speaking, the same thing that makes a scientific paper acceptable: that the analysis is open to review.

* the initial assumptions and methods chosen are clearly described
* the interim results from the analysis are shown
* the way in which the conclusion was reached from those results

It's all about making it possible for a reviewer to repeat your analysis. Even if you don't post all the details straight from the start, they're usually possible to deduce from the post or can be gotten with a followup question. No hedging around the issue is needed, because the data is already there - all the OP needs to do is post it.
 
The bottom line is you can't, really. Unless you happen to also have knowledge in the given area, you really won't know if they're telling the truth or making up some mumbo jumbo. And of course if other posters go "no that all makes sense, coz I know that field too" you don't know if they're being honest.

The only other thing I can propose is, if you really have a lot of knowledge in the specific area, you should be able to explain it in layman's terms so that non-experts understand what you're saying. Unfortunately for some areas this isn't really possible.

For example in the area of audio, part of that expertise is training your ear to identify certain sounds, etc. There's no actual "work" you can show to a layman to prove this, and a layman, without having trained their ear specifically, won't be able to make the distinctions.

In areas of engineering, etc... I can feel confident when people know what they're talking about because they can explain things in ways I understand. Regarding something like the FDR and CVR stuff however, it may be so complex and specialists that they can't actually put it in terms I can comprehend.

Ultimately I think people with expertise in a given area tend to be better at recognising other people with expertise in a different area. Which is probably why many people here accept the analysis and opinions of other JREFers, whereas the truthers dont. Most of us have some level of expertise in some field. Truthers don't seem to have any expertise in anything, including basic communication.

-Gumboot
 
I will never accept the legitimacy of an internet poster unless I truly know who they are.

There are no experts on this forum. I am not sure you are aware of what an expert actually is.

Heres an example; A doctor is NOT an expert on medicine. A world leading consultant in say Dermatology IS an expert.

If we take Gumboot as an example. He may well be a film maker, actor, etc but he is NOT an expert in studying audio and video. The people who work for NASA imaging, who Popular Mechanics used for their hit piece ARE experts.
 
I will never accept the legitimacy of an internet poster unless I truly know who they are.

There are no experts on this forum. I am not sure you are aware of what an expert actually is.

Heres an example; A doctor is NOT an expert on medicine. A world leading consultant in say Dermatology IS an expert.

If we take Gumboot as an example. He may well be a film maker, actor, etc but he is NOT an expert in studying audio and video. The people who work for NASA imaging, who Popular Mechanics used for their hit piece ARE experts.
So if a doctor tells me I have contact dermatitis, I am to totally ignore what he says because he's not an expert?
You really need to work on that analogy. Obviously, you're not an expert in making them.
You don't want to accept people's claims of expertise. Fine. But instead of dismissing his analysis out-of-hand (which is what you do on another thread), how about doing some research of your own to see if his claim is legitimate? Then, if you find something wrong with that, show what's wrong.
Or would that be risking that your pet conclusion might be, you know, actually wrong? And that the "expert" might actually be right?
Or just too hard?
Whining is just so much easier, isn't it?
 
It's very easy to identify the people who are not experts, they are the ones who say that 9/11 was an inside job.
 
Heres an example; A doctor is NOT an expert on medicine. A world leading consultant in say Dermatology IS an expert.



This is a definition of "expert" I have never heard before, and one I think you will find few people would agree with.

Most people recognise an expert as being someone with a reliable source of knowledge, technique, or skill in a given field. This is to distinguish from a layperson, who does not have a reliable source of knowledge, technique, or skill in a given field.

People all across the world go to their doctors for medical advice. They do this because they recognise their doctors as experts in medicine.

There are certainly levels of expertise, and indeed in a given field usually someone is recognised as the leading expert. But this does not mean they are the only expert in that field.

Generally in broad fields, leading experts tend to specialise in one particular field (for example your Dermatology example) whereas "lower ranked" specialists tend to be more general.

-Gumboot
 
So if a doctor tells me I have contact dermatitis, I am to totally ignore what he says because he's not an expert?
You really need to work on that analogy. Obviously, you're not an expert in making them.
You don't want to accept people's claims of expertise. Fine. But instead of dismissing his analysis out-of-hand (which is what you do on another thread), how about doing some research of your own to see if his claim is legitimate? Then, if you find something wrong with that, show what's wrong.
Or would that be risking that your pet conclusion might be, you know, actually wrong? And that the "expert" might actually be right?
Or just too hard?
Whining is just so much easier, isn't it?

If you go to several doctors who maybe dont even agree on your skin condition they will refer you to an expert.

Why should I research his claim? It's his claim, his burden.
 
This is a definition of "expert" I have never heard before, and one I think you will find few people would agree with.

Most people recognise an expert as being someone with a reliable source of knowledge, technique, or skill in a given field. This is to distinguish from a layperson, who does not have a reliable source of knowledge, technique, or skill in a given field.

People all across the world go to their doctors for medical advice. They do this because they recognise their doctors as experts in medicine.

There are certainly levels of expertise, and indeed in a given field usually someone is recognised as the leading expert. But this does not mean they are the only expert in that field.

Generally in broad fields, leading experts tend to specialise in one particular field (for example your Dermatology example) whereas "lower ranked" specialists tend to be more general.

-Gumboot

No disrespect intended again, but if that video of the explosion were ever being used in court, would you be called as the audio expert or would it be some serious professor guy?
 
No disrespect intended again, but if that video of the explosion were ever being used in court, would you be called as the audio expert or would it be some serious professor guy?


I seriously doubt it would be a professor.

I think I already explained that evidence in court requires chain of custody, thus only the original tape would be admissable. The original tape will contain a digital control track which video technicians will analyse to determine the tape's authenticity.

If the control track contains any breaks or indicates it did not originate from the camcorder alleged, it will be rejected out of hand.

At no point will the actual content of the tape itself be a part of the authentication process.

It's worth pointing out (by the way) that said tape would be entirely useless in a court case for proving the existance of explosions at the WTC.

-Gumboot
 
If you go to several doctors who maybe dont even agree on your skin condition they will refer you to an expert.

Why should I research his claim? It's his claim, his burden.
Why would I see several doctors? My first doctor has expertise in the area. He doesn't have as much as a specialist, but would have enough to correctly diagnose most conditions. He also has enough expertise to recognise when he doesn't have the ability to diagnose something, and refer you to someone who does. If I don't agree with his conclusion, and have good reason not to, then maybe I'd see another doctor. But until then, I have no reason to doubt his conclusions. He has relevent experience, I do not.

Also, the burden of proof would still be yours. Here's my scenario. Someone post some video, with audio that seems to show explosions. Someone who claims experience in the area says the audio is fake, with an explaination of why it is fake. He's met his burden of proof, he's shown his work. Now, if you question his explaination, it is now up to YOU to show what is incorrect in that explaination. By doing so, you show that his work is faulty, and call into question his claim of expertise in the area.
Not so hard, is it?
 
Also, the burden of proof would still be yours. Here's my scenario. Someone post some video, with audio that seems to show explosions. Someone who claims experience in the area says the audio is fake, with an explaination of why it is fake. He's met his burden of proof, he's shown his work. Now, if you question his explaination, it is now up to YOU to show what is incorrect in that explaination. By doing so, you show that his work is faulty, and call into question his claim of expertise in the area.
Not so hard, is it?



Or alternatively find the analysis of a more qualified expert who disagrees, and again provides working.

-Gumboot
 
Since this forum is not a courtroom, and is not constrained in the same manner as court proceedings we have a distinct advantage. A statement made by an expert should be factually accurate, logically consistent, and independently verifiable.

Unlike a courtroom, where the qualifications of the "expert witness" must be established, and agreed upon, before their testimony; here we can take their "testimony" corroborate it and, after a number of independent instances of their "testimony" holding up to scrutiny, we can accept them as being an "expert" in the area.

A good example of this would be R. Mackey's work. I've not been forced to call NASA and track down his supervisor to confirm his expertise; rather his continued detailed and confirm-able posts have substantiated his claims.

Once a person's expertise is accepted, you can make allowances for not needed to verify their claims on relevant technical matters as closely as someone whose expertise has not been established. This by no means suggests that their claims can not, or should not, be challenged; merely that, if they are not challenged, it is because they have a track record of being correct.

This is why you will rarely see me claiming expertise on a subject outside of computing and firearms; and you will see me citing experts, outside sources, etc in my arguments.

Regarding Gumboot's analysis; at no time does he make a statement to the effect of, "Trust me, I'm an expert." He statements on his analysis are detailed enough to be independently verifiable and he states what experience he has (thus facilitating his critics ability to corroborate, or refute his claims by allowing them to review to see if the experiences are relevant and finding others with similar experiences to see if they come to the same conclusions).
 
The bottom line is you can't, really.

... you should be able to explain it in layman's terms so that non-experts understand what you're saying. Unfortunately for some areas this isn't really possible.

For example in the area of audio, part of that expertise is training your ear to identify certain sounds, etc. There's no actual "work" you can show to a layman to prove this, and a layman, without having trained their ear specifically, won't be able to make the distinctions.

....



It's true we can never know with certainly, but I think there are some elements of how people post that can give us guidance to conclude they know what they're talking about. We may be occassionally wrong, but on the whole, I think we can reliably recognize a knowedgable person. As an example, from your earlier posts:

Because I downloaded it as an AVI and loaded it into professional film editing and sound post-production software, where I can manipulate it, including isolating the audio. It also means I can repeat the sequences numerous times to clearly determine what is happening. The sound is not out of synch.

I don't know if it's a handycam. I assumed it was to give the benefit of the doubt. Professional cameras do not have stereo microphones, and their shotgun mics - designed specifically to pick up talking in front of them and filter out ambient sound - would pick up an ambient explosion even more poorly. Handycams, by contrast, often have stereo microphones and tend to have less directional microphones.

To be honest the stability and height of the frame suggests it's a shoulder-mounted camcorder of a more professional nature, which only works against the authenticity of the explosion sound.

-Gumboot


Not only do you know that handycams and professional cameras have different microphones, you can explain why they are different, and how those differences affect the audio charateristics of the recordings. Depth and detail of knowledge shines out like a beacon - there's very little question in my mind that you know what you're talking about here.


Ultimately I think people with expertise in a given area tend to be better at recognising other people with expertise in a different area. Which is probably why many people here accept the analysis and opinions of other JREFers, whereas the truthers dont. Most of us have some level of expertise in some field. Truthers don't seem to have any expertise in anything, including basic communication.

-Gumboot


This is one of the questions I was interested in. I didn't want to bias the thread too much right at the start, but I tend to agree with you here. I think someone who does know his own field in depth, can recognize another person who has a similar level of knowledge, even if it's in a different field. There may be limits to this (engineers recognize good physicists, say, but can't distinguish good from bad biologists, perhaps), but in general, I think this is valid.



I will never accept the legitimacy of an internet poster unless I truly know who they are.

There are no experts on this forum. I am not sure you are aware of what an expert actually is.


Well, that's not too surprising.



There are certainly levels of expertise, and indeed in a given field usually someone is recognised as the leading expert. But this does not mean they are the only expert in that field.

Generally in broad fields, leading experts tend to specialise in one particular field (for example your Dermatology example) whereas "lower ranked" specialists tend to be more general.

-Gumboot



Again, here's an example of "knowing your own": recognizing diversity of experience and education, and acknowledging that it's not an all-or-nothing process. Layman -> technician -> skilled -> expert is a continuum, not a binary state.
 
If you go to several doctors who maybe dont even agree on your skin condition they will refer you to an expert.

Why should I research his claim? It's his claim, his burden.

And if you were to ask several of your neighbours what was wrong with your skin, they'd probably tell you to go see a doctor. You know, a medical expert.

I highly doubt that anyone who has spent probably a good six years of their life studying medicine would appreciate being told that they are not medical experts.
 
To me, an expert is someone who can make judgments based on personal knowledge which comes from education and/or experience. This knowledge enables the expert to make accurate decisions, calculations, and estimations while avoiding common mistakes that result from the existence of counter-intuitive truths and misleading observations. An expert may need to use reference material to recall exact information, equations, or characteristics, but this is done from a standpoint of familiarity (the expert has covered the material before and generally remembers it but needs to look up exact details) and the expert will understand the meaning behind the material when it is referenced.

A non-expert, obviously, is not qualified to make judgments based on personal knowledge. The judgment of the non-expert is vulnerable to common mistakes due to non-obvious or counter-intuitive truths because that judgment is often based on broad assumptions and common sense. Non-experts must rely heavily on experts and references, and usually do not understand the principles on which the information is based or how the information was derived.

All experts have subjects that they are not knowledgeable of, despite the fact that the subject technically falls within their field of expertise (when this happens, the expert has an ethical obligation to admit this lack of knowledge when making a judgment). In general, this will happen more with a person who is an expert in a broad topic than one who is an expert in a narrow topic. For example, a general practitioner can be considered an expert in medicine and a dermatologist can be considered an expert in skin medicine. It is expected that the dermatologist has fewer holes in his knowledge of skin medicine than the general practitioner has in his knowledge of medicine in general. Also, when in conflict, the judgment of an expert in a narrow field is generally trusted more than the judgment of an expert in a broad field (assuming both fields contain the issue at hand).

One of the easiest ways to determine if someone is an expert is too see if their judgment is generally trusted. General practitioners are usually trusted by their patients, so they can usually be referred to as experts. This is not a steadfast rule, however, as it can be violated, but it is a good measuring stick to begin with. Of course, this is a very hard measuring stick to use when discussing things in the anonymous world of the internet.

Another good indication of expertise (but again not a steadfast rule) is knowledge of terms. Many words and phrases that have broad definitions when used in casual conversations have very specific definitions when used in a technical sense. An expert will be aware of this and pick/apply words very carefully when performing as analysis. Reading technical engineering documents at my work can be very tedious, for example, because the same word might be used over and over again (sometimes more than a dozen times in one paragraph). If I were reading these documents from a literary point of view, I might suggest the use of synonyms to break up the repetition. But I read them from an engineering point of view, and I am aware that the use of synonyms would be improper because the two words might have subtle but very significant differences in definition when used in a technical context. Perhaps the best example of this I can think of off the top of my head is the use of the terms “steam” and “water vapor.” Those words are often used interchangeably in casual conversations, but they mean two completely different things when used technically.

As mentioned elsewhere in this thread, the best way of determining if someone is an expert is by observing that person’s explanations. An expert should not only be able to describe something, but also describe how that explanation is ultimately derived from first principles or from widely accepted truths (with no use of assumptions without proper justification). This demonstrates knowledge of not only what the truth is, by why the truth is what it is. The transparency of this process is essential, also, as it allows for verification. The importance of verification should be acknowledged by all experts.
 
I will never accept the legitimacy of an internet poster unless I truly know who they are.
This has to be true for you. But I have accepted some internet posters as experts. They have shown widespread awareness in a particular issue. Expert are here.

There are no experts on this forum. I am not sure you are aware of what an expert actually is.
This is an opinion. Not based on facts. I have found experts on this forum. I use facts to base my decision that there are experts on this forum. All you have to do is find a person with extensive knowledge and/or ability in a given subject. They are here, you have to take time to see. It may take a lot of reading to weed through and figure it out. But with some research it can be done.


Heres an example; A doctor is NOT an expert on medicine. A world leading consultant in say Dermatology IS an expert.
This is anecdotal evidence if you are using a personal example. Your opinion is noted but a doctor would be more of an expert than I on medicine. The very definition of a doctor makes him an expert. In your case you must of found a doctor you do not like or something. I guess if you find a doctor lacking a high degree of knowledge in medicine, you could remove the expert stink from him. Looking for a medical expert, u b seeking a doctor. Doctors could be called experts in medicine, just as I call my mechanic an expert in cars.


If we take Gumboot as an example. He may well be a film maker, actor, etc but he is NOT an expert in studying audio and video. The people who work for NASA imaging, who Popular Mechanics used for their hit piece ARE experts.
Gumboot is an expert. He has a high degree of skill and knowledge in this area. The very definition of an expert; Gumboot.
 
I will never accept the legitimacy of an internet poster unless I truly know who they are.
I don't find that comment unreasonable, it makes sense to be cautious. What about the named authors and researchers on the WTC 1& 2 NIST reports, would you consider them to be experts? If not why not and what criteria would you use?
 
I don't find that comment unreasonable, it makes sense to be cautious.




Did you miss the "never" in his comment? Caution is almost always a good thing, but is it really impossible to ever determine if someone is an expert in a forum such as this?

If that's so, what are we all doing here? What's the point of discussing these topics in a sensible manner, if no one's opinions or analysis are any more trustworthy than anyone else's?

Where do we draw the line between reasonable caution, and just being obstructionist?
 
If you go to several doctors who maybe dont even agree on your skin condition they will refer you to an expert.

Why should I research his claim? It's his claim, his burden.

I'm glad you brought this up, because there are some disciplines where even the experts might disagree. That is true of medical diagnoses because many medical issues can be symptomatic of a wide variety of problems, and many others do not present themselves in the typical fashion. In short, the "correct" answer is largely non-deterministic.

Other disciplines, like structural engineering, are more straightforward. In a room full of qualified engineers, you won't have five saying that a given downward force is many times that necessary to cause a building collapse, while five say it is insufficient. It's not a matter of opinion. The discipline is just too cut and dried for these types of disagreements to exist.
 

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom