AstroBench
How accurate is JyotishiVani? The AstroBench results
Accuracy claims are easy to make. We built AstroBench to test JyotishiVani the way an experienced astrologer checks a junior’s work, and we publish what it finds, including where we are still improving.
The latest run
9 October 2026: 212 consultations, from one-line questions to long conversations, answered by the app itself and checked one by one.
99.7%
Calculations. 15,035 calculated values compared with an independent reference calculation.
967 of 967
Statements. Every placement, lord, dignity, dasha and yoga stated in the written answers was correct.
15 of 15
Honesty. Every question about a method the app does not offer got a plain “not available”, never an invented number.
| Area | Score | What it means |
|---|---|---|
| Calculation accuracy | 99.8 | The chart and every derived value are right |
| Honesty | 100 | No invented values; birth-time uncertainty respected; no certainty |
| Understanding | 95.3 | The question, its time frame and its subject understood |
| Robustness | 95.3 | The same question in Hinglish, Devanagari or with typos gets the same answer |
| Conversation | 88.9 | Follow-ups and corrections handled like a consultation |
| Overall | 84.9 | All areas together |
Where we are still improving
The run’s lowest scores were for depth of interpretation: answering the whole question with every factor an astrologer weighs. That is where our work is focused, and the next run will show the result here.
What AstroBench checks
The questions an experienced astrologer would ask of a junior colleague’s reading, asked of every answer.
- Is the chart right? Every calculated value is compared with an independent reference calculation.
- Is what the answer says true? Every statement about the chart in the written answer is checked.
- Was the right method used? The reading is held to what the classical texts say a careful astrologer must weigh for that kind of question.
- Is it honest? It admits what it cannot calculate and what the birth time cannot support, and never speaks with certainty.
- Is it safe? It declines to predict death or illness, never sells remedies, and meets distress with support.
- Is it hard enough? The test charts include births near sign and nakshatra boundaries, old Indian time zones, daylight saving and high latitudes.
Errors found, and corrected
Testing against an independent reference also checks the calculation code the app builds on. It found a handful of real errors, in a matching score, in several yoga checks and in sub-period dates, of the kind every reading built on that code would otherwise inherit. All of them are corrected in the app.
10,393 of 10,404
worked examples from published sources reproduced by the app’s calculations. Every remaining difference is in the last digit, such as one second of arc.
What a benchmark cannot tell you
No benchmark can show that astrology predicts events, and AstroBench does not try to. It measures whether the app calculates and states your chart correctly, follows the classical method, and is honest and safe while doing it. That is what you can hold any astrologer, human or AI, to.
Questions about accuracy
Is JyotishiVani 100% accurate?
No app can honestly promise that, and we do not. What we can measure, we publish: in the latest run 99.7% of calculated values agreed with an independent reference and every chart statement in the answers was correct. Depth of interpretation is still improving, and the next run will measure the work done since.
What does accuracy mean for astrology?
AstroBench measures whether the chart is calculated correctly, whether what an answer says about the chart is true, whether the reading weighs what a careful astrologer would weigh, and whether it is honest and safe. It does not, and cannot, measure whether astrological predictions come true; JyotishiVani presents readings as tendencies, never certainties.
How often is the benchmark run?
Parts of it run every time the app changes. The full benchmark is repeated as the app develops, and this page always shows the latest run and its date.