Confidence in Classification using LLMs and Conformal Sets
One of the common use cases for large language models is classifying text -- but data scientists often want to know the confidence that the text falls into the category. This blog post shows an example using a models log-probabilities to determine if text has obscene language, while setting the recall rate or estimating the precision of the classification.
Getting Updates
If you wish to get updates from the CRIME De-Coder, use the RSS feed to get updates in Outlook or a feed reader (like Inoreader). Or use a service like IFTTT to sign up for email alerts when CRIME De-Coder posts new content (via the RSS feed to email app).
Archives
- Confidence in Classification using LLMs and Conformal Sets
- Large Language Models for Mortals book released
- Planning an Experiment in Increasing Arrest Rates
- We don't know what causes wide spread crime trends
- Coding Agents Risk Leaking Secrets
- A graph is worth 1000 tables
- Translations of Python book into Spanish and French
- Using the SPPT to Monitor Changes in Crime
- Is gun shot detection tech worth the cost?
- Using LLMs to Extract Data from Text
- Finding outliers in proportions
- Denver's STAR Program and Disorder Crime Reductions
- Some extensions to the WDD statistic
- Why crime analysts should learn SQL
- Crime Analysts make too many BOLOs
- Junk science: Detecting deception in 911 homicide calls
- A market for empirical research
- How to use python to query your RMS
- Applications of AI in policing
- Aoristic Analysis of Uncertain Crime Times in Python
- Wake Libertarian Talk on LPRs
- Crime Analysis with Python Book Released
- Simple rule to identify if rare crimes have spiked
- Geocoding Crime Data Locally
- Building Custom Software
- Compstat and Counterfactuals
- Using surveys to measure attitudes towards police
- AI regulation in policing
- Dashboard Advice
- What are Early Intervention Systems
- How to Evaluate Pred Policing Software
- Custom Training Services
- Early Release of Data Science for Crime Analysis with Python Book
- NLP applications in crime analysis
- Tech recruiting PhDs
- PDs should share crime data
- Using data to establish reasonableness in premises liability cases
- A Primer on SNA for Crime Analysts
- Additional Services CRIME De-Coder offers
- Dashboards should be up-to-date
- Don't use percent change for crime data, use this stat instead
- $$$ Million Dollar HotSpots $$$
- What distinguishes CRIME De-Coder from other firms