Go to file
2017-06-17 07:56:52 +07:00
cdp Updating to latest protocol.json 2017-06-06 17:57:18 +07:00
client Updating latest protocol.json and adding some minor comment updates 2017-02-07 20:07:16 +07:00
cmd Minor changes to chromedp-gen/build.sh 2017-06-17 07:56:52 +07:00
contrib Updating grab-headless_shell.sh script 2017-05-24 09:49:25 +07:00
examples Adding pool example 2017-04-05 10:00:51 +07:00
kb Fixing remaining gofmt/misspell issues for goreportcard 2017-03-02 10:24:35 +07:00
runner chromium is also an option for executable name on Linux 2017-05-30 14:17:20 +07:00
testdata Fixing issue when node is offscreen and more. 2017-02-27 19:17:36 +07:00
.gitignore Adding safeguards around Shutdown and AddTarget 2017-03-13 09:09:57 +07:00
.travis.yml Fixing typo in travis config 2017-05-24 10:03:55 +07:00
actions.go Renaming FrameHandler, updating to latest protocol.json, and code fixes 2017-02-12 12:50:46 +07:00
chromedp_test.go Removing external url on navigation and query actions. 2017-02-22 19:55:45 +07:00
chromedp.go Adding safeguards around Shutdown and AddTarget 2017-03-13 09:09:57 +07:00
doc.go Renaming FrameHandler, updating to latest protocol.json, and code fixes 2017-02-12 12:50:46 +07:00
errors.go Code cleanup 2017-02-12 14:08:40 +07:00
eval.go Fixing misspelling issues 2017-03-02 09:53:47 +07:00
handler.go Adding script to generate domains from protocol.json and updating to latest protocol.json 2017-05-06 08:20:24 +07:00
input_test.go Adding script to generate domains from protocol.json and updating to latest protocol.json 2017-05-06 08:20:24 +07:00
input.go Revising ScrollIntoView Action 2017-02-28 08:35:00 +07:00
LICENSE Initial import 2017-01-24 22:09:23 +07:00
nav_test.go Fixing misspelling issues 2017-03-02 09:53:47 +07:00
nav.go Revising ScrollIntoView Action 2017-02-28 08:35:00 +07:00
pool.go Fixing panic on Pool.Release 2017-02-22 15:27:38 +07:00
query_test.go Fixing misspelling issues 2017-03-02 09:53:47 +07:00
query.go Revising ScrollIntoView Action 2017-02-28 08:35:00 +07:00
README.md Updating todo section in README.md 2017-03-13 09:25:10 +07:00
sel_test.go Adding script to generate domains from protocol.json and updating to latest protocol.json 2017-05-06 08:20:24 +07:00
sel.go Minor code cleanup/maintenance on generated cdp protocol 2017-02-18 15:36:24 +07:00
util.go Adding script to generate domains from protocol.json and updating to latest protocol.json 2017-05-06 08:20:24 +07:00

About chromedp Build Status Coverage Status

Package chromedp is a faster, simpler way to drive browsers in Go using the Chrome Debugging Protocol (for Chrome, Edge, Safari, etc) without external dependencies (ie, Selenium, PhantomJS, etc).

NOTE: chromedp's API is currently unstable, and may change at a moments notice. There are likely extremely bad bugs lurking in this code. CAVEAT USER.

Installation

Install in the usual way:

go get -u github.com/knq/chromedp

Usage

Below is a simple Google search performed using chromedp (taken from examples/simple):

This example shows logic for a simple search for a known website, clicking on the right link, and then taking a screenshot of a specific element on the loaded page and saving that to a local file on disk.

package main

import (
	"context"
	"fmt"
	"io/ioutil"
	"log"
	"time"

	cdp "github.com/knq/chromedp"
	cdptypes "github.com/knq/chromedp/cdp"
)

func main() {
	var err error

	// create context
	ctxt, cancel := context.WithCancel(context.Background())
	defer cancel()

	// create chrome instance
	c, err := cdp.New(ctxt)
	if err != nil {
		log.Fatal(err)
	}

	// run task list
	var site, res string
	err = c.Run(ctxt, googleSearch("site:brank.as", "Easy Money Management", &site, &res))
	if err != nil {
		log.Fatal(err)
	}

	// shutdown chrome
	err = c.Shutdown(ctxt)
	if err != nil {
		log.Fatal(err)
	}

	// wait for chrome to finish
	err = c.Wait()
	if err != nil {
		log.Fatal(err)
	}

	log.Printf("saved screenshot of #testimonials from search result listing `%s` (%s)", res, site)
}

func googleSearch(q, text string, site, res *string) cdp.Tasks {
	var buf []byte
	sel := fmt.Sprintf(`//a[text()[contains(., '%s')]]`, text)
	return cdp.Tasks{
		cdp.Navigate(`https://www.google.com`),
		cdp.Sleep(2 * time.Second),
		cdp.WaitVisible(`#hplogo`, cdp.ByID),
		cdp.SendKeys(`#lst-ib`, q+"\n", cdp.ByID),
		cdp.WaitVisible(`#res`, cdp.ByID),
		cdp.Text(sel, res),
		cdp.Click(sel),
		cdp.Sleep(2 * time.Second),
		cdp.WaitVisible(`#footer`, cdp.ByQuery),
		cdp.WaitNotVisible(`div.v-middle > div.la-ball-clip-rotate`, cdp.ByQuery),
		cdp.Location(site),
		cdp.Screenshot(`#testimonials`, &buf, cdp.ByID),
		cdp.ActionFunc(func(context.Context, cdptypes.FrameHandler) error {
			return ioutil.WriteFile("testimonials.png", buf, 0644)
		}),
	}
}

Please see the examples directory for some more examples, and please refer to the GoDoc API listing for a summary of the API and Actions.

TODO

  • Move timeouts to context (defaults)
  • Implement more query selector options (allow over riding context timeouts)
  • Contextual actions for "dry run" (or via an accumulator?)
  • Network loader / manager
  • Profiler