Comparing diversity under collection bias

 
 
 True A : B – 
 — – 
 
 

Fragments of Cultural Change on Folgert Karsdorp
Recent content in Fragments of Cultural Change on Folgert Karsdorp
Latest posts
What Shall We Do with the Unseen Sailor?
Bias in historical records 
 At the Computational Humanities Research conference 2022 held in Antwerp from December 12
to 14, I co-presented a new paper with Melvin Wevers on missing data in historical
archives. The paper was pubslished with CEUR-WS and can be found here:
 https://ceur-ws.org/Vol-3290/short_paper1793.pdf . Missing data is rather the norm than the
exception in…
List of publications

 Books 
 
 
Kestemont, Mike, and Folgert Karsdorp. 2024. Het Mysterie van de
Verdwenen Ridderromans . Letterwerk. https://doi.org/10.5281/zenodo.10807547 .
 
 
Karsdorp, Folgert, Mike Kestemont, and Allen Riddell. 2021.
 Humanities Data Analysis. Case Studies with Python . Princeton
University Press.…
Estimating Unseen Shared Cultural Diversity
Shared Species Estimation 
 In Demystifying Chao1 with Good-Turing , I tried to explain the intuition behind the Chao1
estimator ( Chao 1984 ) for unseen species using the
Good-Turing estimator as described in Chao et al. ( 2017 ). The
latter article discusses another set of diversity measures within that same framework of
Turing. The number of unique species or the number of…
Population Size Estimation as a Regression Problem
Unseen heterogeneity 
 Unseen Species Model s such as Chao1 provide accurate point-estimates of the population
size when the rare species in studied sample are homogeneous. That is, in the case of
animal species, for example, all species are equally likely to be observed. Of course,
this is a simplifying assumption. Some species are simply more difficult to spot than
others,…
Estimating Richness under Sampling without Replacement
Unseen Species Models such as Chao1 assume that the sample being studied was created with
replacement. This means that calculations are based on the assumption that certain
individuals can or have been repeatedly observed. It also implies that the observation of
one individual does not influence the observation of the next individual. That is to say:
observations are independent.…
Demystifying Chao1 with Good-Turing
To estimate the “ biodiversity ” in a particular area – or, in other words, the number of
unique species living in a given environment – ecologists usually have no other option
than to rely on incomplete samples. For all sorts of practical reasons, it is virtually
impossible to spot all species that are actually present in an area, and hence certain
species…