Skip to content
Sign in Submit a tool

Preference Model vs BenchFleet

A side-by-side comparison built from both listings. Blank cells mean the company has not given that detail; we never guess.

Preference Model compared with BenchFleet
DetailPreference Model logo Preference ModelBenchFleet logo BenchFleet
What it doesOpen-sourcing Karotte, a framework for building robust reinforcement learning environments Android phone control hub for people and AI agents
StageNot given Startup
FoundedNot given 2026
Based inNot given GB
Pricing modelOpen source Freemium
PricingNot given Free: £0 for up to 3 phones with no account. Pro: £12 a month + VAT or £120 a year for up to 25 phones with workflows and schedules. Team: £20 per seat a month + VAT or £200 per seat a year for unlimited phones. Cloud phones: £0.02 a minute from prepaid packs (£10 for 500 minutes, £25 for 1,250 minu
Key features
  • Sandboxed execution with non-privileged user isolation
  • Process termination before grading
  • Suspicious file detection and rejection
  • Out-of-memory and fork-bomb prevention
  • Hardened through one million evaluation runs
  • Red-team tested for reward hacking vulnerabilities
  • Scalable environment execution
  • Robust benchmark building support
  • Take control of any phone with mouse and keyboard
  • Record and run workflows on one or many phones
  • Schedules and group actions across phones
  • Approvals for sensitive operations
  • Encrypted vault for secrets
  • Local mode with no telemetry by default
  • Cloud Android phones available by the minute
What makes it different
  • Provides secure defaults and primitives specifically designed to prevent reward hacking in RL training
  • Hardened through real-world testing at scale with over one million evaluation runs
  • Designed for training environments where defenses must withstand continuous optimization attempts
  • Addresses AI alignment at the highest leverage point through better environment construction
  • Built and tested internally by frontier AI research team
  • Flat-rate pricing per plan instead of per-minute device cloud fees
  • Runs entirely on your own computer with no telemetry
  • Stops AI at human-only checks like CAPTCHAs
Free planNot given Not given
Open sourceNot given Not given
PlatformsNot given Not given
Public APINot given Not given
Community votes00
DR (Domain Rating by Ahrefs)29 +1 (up) since last check18 no change since last check
Trust Flow (Majestic)110
Citation Flow (Majestic)2421
Referring domains (Majestic)984

4 details filled in for both companies.

More alternatives to Preference Model More alternatives to BenchFleet

Help centre