Lotta Supply

Development Log

Back to all entries

Improved AI Fill reliability and security

We significantly enhanced the reliability and security of the AI Fill feature. The bulk fill process was reworked to provide more focused attention to individual sections of a report, ensuring that all fields, including those in repeater tables, receive adequate processing time. This addresses an issue where earlier sections would exhaust the AI's budget, leaving later sections incomplete.

Security improvements were also implemented to prevent prompt injection vulnerabilities. We added robust sanitization of section labels to prevent malicious template authors from injecting arbitrary instructions or forging log entries. These measures ensure the integrity of the AI Fill process and prevent unintended behavior.

Additionally, we addressed a bug where failures in certain sections were not correctly reflected in the UI. Now, when a section fails to fill, the corresponding fields are accurately marked as missing, providing a more accurate view of what needs manual attention. We also increased the default AI fill parallelism to improve the speed of filling reports.

Finally, we increased the search budget allocated to repeater fields during bulk fill, improving data extraction for those fields.

View source activity

Commits (5)

  • test(api): relax integration test timeout
  • chore: add deploy skill and report artifacts
  • docs(env): document AI fill knobs in .env.example (LOT-83)
  • feat(ai-fill): split bulk fill into per-section calls (LOT-83) (#199)
  • fix(ai-fill): improve bulk fill extraction reliability (#198)

Pull Requests (2)

  • #199: feat(ai-fill): split bulk fill into per-section calls (LOT-83)
  • #198: fix(ai-fill): improve bulk fill extraction reliability