Important: This documentation covers Yarn 1 (Classic).
For Yarn 2+ docs and migration guide, see yarnpkg.com.

Package detail

@jahed/chromeless

graphcool22MITdeprecated1.4.0TypeScript support: included

This is a temporary package that is not maintained. The author has moved on. It's time for you to move to something else too before the cracks start showing.

🖥 Chrome automation made simple. Runs locally or headless on AWS Lambda.

readme

Chromeless

npm version CircleCI Greenkeeper badge

Chrome automation made simple. Runs locally or headless on AWS Lambda. (See Demo)

Chromeless can be used to...

  • Run 1000s of browser integration tests in parallel ⚡️
  • Crawl the web & automate screenshots
  • Write bots that require a real browser
  • Do pretty much everything you've used PhantomJS, NightmareJS or Selenium for before

Examples

▶️ Try it out

You can try out Chromeless and explore the API in the browser-based demo playground (source).

Contents

  1. How it works
  2. Installation
  3. Usage
  4. API Documentation
  5. Configuring Development Environment
  6. FAQ
  7. Contributors
  8. Credits
  9. Help & Community

How it works

With Chromeless you can control Chrome (open website, click elements, fill out forms...) using an elegant API. This is useful for integration tests or any other scenario where you'd need to script a real browser.

There are 2 ways to use Chromeless

  1. Running Chrome on your local computer
  2. Running Chrome on AWS Lambda and controlling it remotely

1. Local Setup

For local development purposes where a fast feedback loop is necessary, the easiest way to use Chromeless is by controlling your local Chrome browser. Just follow the usage guide to get started.

2. Remote Proxy Setup

You can also run Chrome in headless-mode on AWS Lambda. This way you can speed up your tests by running them in parallel. (In Graphcool's case this decreased test durations from ~20min to a few seconds.)

Chromeless comes out of the box with a remote proxy built-in - the usage stays completely the same. This way you can write and run your tests locally and have them be executed remotely on AWS Lambda. The proxy connects to Lambda through a Websocket connection to forward commands and return the evaluation results.

Installation

npm install chromeless

Proxy Setup

The project contains a Serverless service for running and driving Chrome remotely on AWS Lambda.

  1. Deploy The Proxy service to AWS Lambda. More details here
  2. Follow the usage instructions here.

Usage

Using Chromeless is similar to other browser automation tools. For example:

const { Chromeless } = require('chromeless')

async function run() {
  const chromeless = new Chromeless()

  const screenshot = await chromeless
    .goto('https://www.google.com')
    .type('chromeless', 'input[name="q"]')
    .press(13)
    .wait('#resultStats')
    .screenshot()

  console.log(screenshot) // prints local file path or S3 url

  await chromeless.end()
}

run().catch(console.error.bind(console))

Local Chrome Usage

To run Chromeless locally, you need a recent version of Chrome or Chrome Canary installed (version 60 or greater). By default, chromeless will start Chrome automatically and will default to the most recent version found on your system if there's multiple. You can override this behavior by starting Chrome yourself, and passing a flag of launchChrome: false in the Chromeless constructor.

To launch Chrome yourself, and open the port for chromeless, follow this example:

alias canary="/Applications/Google\ Chrome\ Canary.app/Contents/MacOS/Google\ Chrome\ Canary"
canary --remote-debugging-port=9222

Or run Chrome Canary headless-ly:

canary --remote-debugging-port=9222 --disable-gpu --headless

Or run Chrome headless-ly on Windows:

cd "C:\Program Files (x86)\Google\Chrome\Application"
chrome --remote-debugging-port=9222 --disable-gpu --headless

Proxy Usage

Follow the setup instructions here.

Then using Chromeless with the Proxy service is the same as running it locally with the exception of the remote option. Alternatively you can configure the Proxy service's endpoint with environment variables. Here's how.

const chromeless = new Chromeless({
  remote: {
    endpointUrl: 'https://XXXXXXXXXX.execute-api.eu-west-1.amazonaws.com/dev',
    apiKey: 'your-api-key-here',
  },
})

API Documentation

Chromeless methods

Chrome methods

Configuring Development Environment

Requirements:

  • NodeJS version 8.2 and greater

1) Clone this repository 2) Run npm install 3) To build: npm run build

Linking this NPM repository

1) Go to this repository locally 2) Run npm link 3) Go to the folder housing your chromeless scripts 4) Run npm link chromeless

Now your local chromeless scripts will use your local development of chromeless.

FAQ

How is this different from NightmareJS, PhantomJS or Selenium?

The Chromeless API is very similar to NightmareJS as their API is pretty awesome. The big difference is that Chromeless is based on Chrome in headless-mode, and runs in a serverless function in AWS Lambda. The advantage of this is that you can run hundreds of browsers in parallel, without having to think about parallelisation. Running integration Tests for example is much faster.

I'm new to AWS Lambda, is this still for me?

You still can use this locally without Lambda, so yes. Besides that, here is a simple guide on how to set the lambda function up for Chromeless.

How much does it cost to run Chromeless in production?

The compute price is $0.00001667 per GB-s and the free tier provides 400,000 GB-s. The request price is $0.20 per 1 million requests and the free tier provides 1M requests per month.

This means you can easily execute > 100.000 tests for free in the free tier.

Are there any limitations?

If you're running Chromeless on AWS Lambda, the execution cannot take longer than 5 minutes which is the current limit of Lambda. Besides that, every feature that's supported in Chrome is also working with Chromeless. The maximal number of concurrent function executions is 1000. AWS API Limits

Troubleshooting

Error: Unable to get presigned websocket URL and connect to it.

In case you get an error like this when running the Chromeless client:

{ HTTPError: Response code 403 (Forbidden)
    at stream.catch.then.data (/code/chromeless/node_modules/got/index.js:182:13)
    at process._tickDomainCallback (internal/process/next_tick.js:129:7)
  name: 'HTTPError',
...
Error: Unable to get presigned websocket URL and connect to it.

Make sure that you're running at least version 1.19.0 of serverless. It is a known issue, that the API Gateway API keys are not setup correctly in older Serverless versions. Best is to run npm run deploy within the project as this will use the local installed version of serverless.

Resource ServerlessDeploymentBucket does not exist for stack chromeless-serverless-dev

In case the deployment of the serverless function returns an error like this:

  Serverless Error ---------------------------------------

  Resource ServerlessDeploymentBucket does not exist for stack chromeless-serverless-dev

Please check, that there is no stack with the name chromeless-serverless-dev existing yet, otherwise serverless can't correctly provision the bucket.

No command gets executed

In order for the commands to be processed, make sure, that you call one of the commands screenshot, evaluate, cookiesGetAll or end at the end of your execution chain.

Contributors

A big thank you to all contributors and supporters of this repository 💚

joelgriffith adieuadieu schickling timsuchanek Chrisgozd criticalbh d2s emeth- githubixx hax Hazealign joeyvandijk liady matthewmueller seangransee sorenbs toddwprice vladgolubev

Credits

Help & Community Slack Status

Join our Slack community if you run into issues or have questions. We love talking to you!

changelog

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog and this project adheres to Semantic Versioning.

[Unreleased]

Added

  • Extend screenshot with specific file path locally & screenshot element by selector #137, #83, #41, #113 @elisherer
  • Documentation for Chromeless constructor options #243, #54 @janza

Changed

Fixed

[1.3.0] - 2017-08-29

Added

  • It's now possible to specify an S3 object key prefix in with a CHROMELESS_S3_OBJECT_KEY_PREFIX environment variable #224 @pklingem
  • A parameter to specify waitTimeout when waiting for a selector with wait(selector, waitTimeout) #212, #208 @janza

Fixed

  • Mistakes in scrollTo parameters API documentation #220 @okeeffed
  • Typo in mocha/chai example #218 @sul4bh
  • Fixed unhandled promise rejection error in chromeless.end() #213, #187 @janza

[1.2.0] - 2017-08-06

Added

  • clearInput() API method #151, #133 @criticalbh
  • setViewport() API method #115 @joeyvandijk
  • setFileInput() API method #100, #170 @criticalbh
  • clearCache() API method #122 @joeyvandijk
  • scrollToElement() command and scrollBeforeClick constructor option #15, #167 @janza
  • cookies(name: string) API method #183 @criticalbh
  • Mocha E2E tests example #164 @FabioAntunes

Changed

  • Breaking: renamed cookiesClear() to deleteCookies(), cookiesClearAll() to clearCookies() and according to semver should bump the version to 2.0.0, however, just-this-time, we're not going to. #123 @joeyvandijk
  • Breaking: renamed cookiesGet(name: string | query: CookieQuery) to cookies(name: string | query: CookieQuery), cookiesGet() to cookies() and cookiesGetAll() to allCookies() #183 @criticalbh
  • Breaking: renamed cookiesSet() to setCookies(), cookiesGet() to cookies() and cookiesGetAll() to allCookies() #185 @adieuadieu

Fixed

  • Chromeless can now be imported into TypeScript projects with activated strictNullChecks compiler option #154 @clebert
  • Fixed an issue in clearCookies() to check that it can clear cookies before trying to clear them #123 @joeyvandijk
  • When initialising runtime with options.launchChrome = false, use port from options instead of this.chromeInstance, the latter of which does not contain port information when Chromeless did not launch Chrome itself (e.g. in the Proxy) #162, #99 (comment), #159 @torbs
  • Removed packaging excludes in the Proxy so that chrome-launcher dependencies are included in the deployment package. #99 (comment), #173 @adieuadieu
  • We're now using os.tmpdir() when saving screenshots/pdfs to disk. #129, #172, #137 @Kivol, @elisherer

[1.1.0] - 2017-08-02

Added

  • When using Chromeless locally, Chromeless will now boot Chrome automatically #120 @joelgriffith
  • html() and setHtml() API methods for getting and setting HTML #112, #74 @seangransee
  • mousedown() and mouseup() API methods #118 @criticalbh
  • focus() API method #132 @criticalbh
  • pdf() API method #84 @seangransee
  • setUserAgent() API method to set the user-agent #117 @joeyvandijk
  • CODE_OF_CONDUCT.md, CONTRIBUTING.md

Changed

  • CDP options now get passed to CDP.New() #103 @liady
  • .evaluate() now returns the resulting value or a Promise #110 @joelgriffith
  • README improvements. @timsuchanek @adieuadieu @hax @Chrisgozd @githubixx @d2s @vladgolubev

Fixed

  • Ensure latest version of Serverless is used during deployment. #58 @adieuadieu
  • package repository url #64 @Hazealign
  • Spelling and minor bugfix when Chromeless calls Version in CPD #120 @joelgriffith

[1.0.1] - 2017-07-27

Added

  • CHANGELOG.md
  • LICENSE file (MIT)
  • implicitWait: By default wait for .press and .click for a cleaner workflow

Changed

  • .end(): now returns the last value

Fixed

  • The cookie commands broke the queue, now they work like expected

Changed

  • Many README improvements. @schickling @sorenbs @emeth- @timsuchanek @adieuadieu @toddwprice

[1.0.0] - 2017-07-26

Added

  • Initial public release
  • Initial version of Chromeless
  • Initial version of Chromeless Proxy