Frequently Asked Questions
Learn about Civic Sunlight
How do we grade and rate our newsletters?
We evaluate our newsletters using a structured scoring system that assesses three key areas: accuracy, breadth, and depth. Accuracy ensures that all facts are correct, properly attributed, and free from duplication. Breadth measures whether we cover all major topics and decisions from a meeting. Depth evaluates whether we provide enough context and detail for readers to fully understand an issue.
Each newsletter receives a score from 0 to 100 in each category, with points deducted for missing details, factual errors, or redundant information. Our process involves multiple verification steps, including fact-checking against transcripts, identifying missing topics, and ensuring that discussions are presented in the correct context. This approach helps us maintain high editorial standards and provide readers with a clear, trustworthy summary of local governance.
How do we ensure our summaries are accurate?
We use a multi-step AI-driven process to ensure our summaries are as accurate as possible. Our framework leverages multiple large language models (LLMs) to cross-check and verify information, contextualizing it with authoritative, locality-based data. This approach allows us to maintain a consistent accuracy rate of 95-97% when processing transcripts. Unlike traditional reporting, we do not use human editors in the loop—our goal is to provide coverage where local journalism resources are stretched thin.
While our AI models work to minimize errors, we recognize that AI is inherently probabilistic. We regularly receive feedback on errors or inconsistencies and continuously refine our algorithms to improve accuracy. Our focus is on delivering high-level summaries that pique interest, spark discussion, and enhance civic awareness, rather than replacing journalism or detailed investigative reporting.
What types of meetings do we cover?
Civic Sunlight focuses on local government meetings, particularly those that newsrooms and the public may not have the time or resources to cover in full. Our system prioritizes meetings that impact policy, budgets, public services, and community planning—ensuring that essential discussions are surfaced and accessible.
While we process a broad range of public meetings, we do not cover closed sessions or informal gatherings that lack official records. Our primary audience includes newsrooms looking for regional insights, helping them track important stories across multiple municipalities. The public-facing version of our content is a streamlined summary, designed to increase civic awareness and engagement without overwhelming readers with excessive detail.