🔄 Smart Tunneling EnhancementCLI v0.1.15:
- Automatic localhost detection: CLI now automatically detects localhost URLs in your configuration and creates tunnels without requiring the
--local
flag - Simplified workflow: No manual flag needed - just run
playmatic run
and localhost URLs are tunneled automatically - Seamless local development: Zero-configuration tunneling for any localhost-based environment setup
http://localhost:3000
), Playmatic automatically creates secure HTTPS tunnels without needing the --local
flag. This streamlines local development testing by removing an extra step from your workflow.🚀 Performance & UX ImprovementsCLI v0.1.14:
- Optimized execution speed: Refined computer action delays for faster, more reliable test execution
- Enhanced reasoning visibility: Improved logging and output to better understand agent decision-making
🔔 Major Feature: Automated CI NotificationsCLI v0.1.9:
- Smart CI notifications: Automatic Slack notifications for GitHub Actions test runs
- Rich context: Includes repository, branch, commit, and workflow information in notifications
- Team-aware: Respects existing team notification preferences (all results vs issues only)
- Multi-channel delivery: Sends notifications to all Slack channels where your bot is invited
- GitHub integration: Full GitHub metadata captured in CI environments
🚀 Major Feature: GitHub Actions CI IntegrationCLI v0.1.8:
- Automated CI setup: New
playmatic ci-setup
command for instant GitHub Actions integration - GitHub Action v1.0.0: Local CLI execution with environment support
- One-command setup: From zero to CI in under 1 minute
playmatic ci-setup
to automatically create GitHub Actions workflows, generate CI API keys, and get direct links to configure secrets. Your Playmatic tests can now run seamlessly in GitHub Actions with full video recording support.CLI v0.1.3:
- Video recordings: View complete video recordings of your test sessions after completion
- Smooth exit handling: Ctrl+C now works reliably with proper cleanup
- Better parallelization: Improved performance for concurrent test execution
- Enhanced output: Computer use reasoning logs now visible during test execution
CLI v0.1.2:
- Optimized default timeout: Reduced default
actionTimeout
from 15s to 10s for faster test execution - Cleaner sample configuration: Removed sampleEnv complexity in generated config
- Better environment guidance: Added documentation links and clearer comments in generated config
- Simplified sample test: Uses hardcoded URL for immediate testing without environment setup
CLI v0.1.1:
- Simplified setup: Default environment now set to
sampleEnv
for immediateplaymatic run
usage - Better onboarding: New users can run tests instantly without environment flags
- Clear migration path: Added helpful comments in generated config for transitioning to development environment
- Streamlined CLI output: Simplified setup success messages
playmatic setup
, you can now immediately run tests with just playmatic run
- no need to specify environments for the sample test. The generated config includes clear guidance on customizing environments for your own application.🎉 Major Release: Playmatic CLI & SDK v0.1.0⚠️ Breaking Changes - See migration guideCLI v0.1.0:Migration Required: Existing tests need updates. See our complete migration guide.
- TypeScript configuration: Support for
playmatic.config.ts
files - Environment switching: New
--env
flag for easy environment management - Local development tunneling: New
--local
flag for automatic tunnel creation - Updated setup command: Generates TypeScript config files by default
- New test signature: Test functions now require
({ env }) => {}
parameter - Environment-based configuration: Access
env.baseUrl
andenv.vars.*
in tests - Computer use agent visibility: All environment variables automatically available during healing
- Centralized config management: Define environments in TypeScript config files
--local
flag makes testing localhost applications effortless:- Zero configuration: No accounts, API keys, or setup required
- Automatic tunneling: Instantly creates secure HTTPS tunnels for local apps
- DNS handling: Built-in DNS propagation wait for reliable connectivity
- Environment integration: Works seamlessly with the new environment system
CLI Improvements:
- Separate config command: Added dedicated
playmatic config
command - Enhanced validation: Better 4xx response handling and error messages
- App URL improvements: Refined prompts for application URL configuration
CLI v0.0.14:
- Improved prompts: Renamed app URL prompt for better clarity
- Test structure update: Changed from “name” to “goal” for better test organization
- Consistency improvements: Aligned terminology across CLI and SDK
CLI v0.0.13:
- Test structure: Updated to use “goal” instead of “name” for clearer test definitions
- Removed expect: Cleaned up unnecessary Playwright expect import
- Performance improvements: Optimized SDK bundle size
CLI v0.0.12:
- Optimization: Removed unnecessary calls to
pageTitle
andcurrentUrl
- Faster execution: Improved test runner performance
- Import cleanup: Removed unnecessary Playwright imports
- Bundle optimization: Reduced SDK footprint
CLI v0.0.11:
- Precompile support: Added precompilation for faster test execution
- Build improvements: Enhanced TypeScript compilation process
- Playwright integration: Added
expect
,browser
, andcontext
from Playwright - Enhanced testing capabilities: Better integration with Playwright test utilities
CLI v0.0.10:
- Updated sample test: Improved default test examples and templates
- Better onboarding: Enhanced setup experience for new users
- TestStepOptions: Added proper TypeScript interfaces for test step options
- Type safety: Improved IntelliSense and development experience
CLI v0.0.9:
- Crash prevention: Fixed invalid page states that could cause crashes
- Improved output display: Better formatting and error reporting
- Enhanced messaging: Clearer user communication throughout test execution
CLI v0.0.8:
- Enhanced output: Improved test execution output and logging
- Better visibility: More detailed progress reporting
- Initial public release: Core
test
andtestStep
functions for defining E2E tests - Playwright support: Both Playwright code and natural language test steps
- Function overloads: Optional execute functions for flexible test definitions
- TypeScript support: Full type definitions and IntelliSense
CLI v0.0.7:
- App URL configuration: Added
appUrl
to config file for easier setup - Config management: Streamlined configuration file handling
- SDK integration: Updated to latest
@playmatic/sdk
CLI v0.0.6:
- SDK updates: Updated to latest
@playmatic/sdk
version - Compatibility: Improved integration between CLI and SDK
- Enhanced setup: Added configuration management and sample tests during setup
- Better onboarding: Streamlined initial user experience
- Sample tests: Included example tests to get started quickly
CLI v0.0.4:
- Playwright cache variables: Added more Playwright variables for improved cache function performance
- Better caching: Enhanced test step caching with additional context
- Using AI tools: AI coding agents section has been turned into Claude & Cursor specific guides
- Playwright clarity: Clarified that the Playwright code is optional & users do not have to install the Playwright package for cached actions
- Bug fixes: Improved tips & notes in various sections to better guide readers
CLI v0.0.3:
- API authentication: Added API auth on endpoints for secure communication
- Code cleanup: Removed unused code and improved performance
- Security: Enhanced authentication handling
- Self-healing tests: Playmatic tests are self-healing using natural language and cache functions with Playwright-compatible code
- Generate tests: Generate tests using natural language with the AI composer
- Run tests locally: Run Playmatic tests directly from your development machine
- Parallel execution: Run multiple tests simultaneously for faster feedback
- Documentation: Read the documentation to get started quickly and understand our framework