Selenate-Common


License

License

MIT
Categories

Categories

Net
GroupId

GroupId

net.selenate
ArtifactId

ArtifactId

selenate-common
Last Version

Last Version

0.3.13
Release Date

Release Date

Type

Type

jar
Description

Description

Selenate-Common
Selenate-Common
Project URL

Project URL

https://github.com/tferega/selenate
Project Organization

Project Organization

net.selenate
Source Code Management

Source Code Management

https://github.com/tferega/selenate

Download selenate-common

How to add to project

<!-- https://jarcasting.com/artifacts/net.selenate/selenate-common/ -->
<dependency>
    <groupId>net.selenate</groupId>
    <artifactId>selenate-common</artifactId>
    <version>0.3.13</version>
</dependency>
// https://jarcasting.com/artifacts/net.selenate/selenate-common/
implementation 'net.selenate:selenate-common:0.3.13'
// https://jarcasting.com/artifacts/net.selenate/selenate-common/
implementation ("net.selenate:selenate-common:0.3.13")
'net.selenate:selenate-common:jar:0.3.13'
<dependency org="net.selenate" name="selenate-common" rev="0.3.13">
  <artifact name="selenate-common" type="jar" />
</dependency>
@Grapes(
@Grab(group='net.selenate', module='selenate-common', version='0.3.13')
)
libraryDependencies += "net.selenate" % "selenate-common" % "0.3.13"
[net.selenate/selenate-common "0.3.13"]

Dependencies

compile (4)

Group / Artifact Type Version
com.typesafe.akka : akka-actor_2.12 jar 2.4.16
com.typesafe.akka : akka-remote_2.12 jar 2.4.16
com.typesafe.akka : akka-slf4j_2.12 jar 2.4.16
com.typesafe : config jar 1.3.1

Project Modules

There are no modules declared in this project.

Selenate

Selenate is a cloud-based web-scraping framework build on top of Selenium WebDriver, which aims to simplify complex scraping jobs, and extend basic Selenium functionality.

Arhitecture

Selenate is based on Client-Server arhitecture. Server hosts scraping sessions and runs the browsers while clients connect to the sessions and issue commands.

Arhitecture

In this example, we have three clients and two servers: Client 1 has two active sessions: one on Server 1, and the other on Server 2, while Client 2 and Developer are both connected to session 9f2749af.

Features

List of Selenate's main features:

Session management

Each scraping process has a session associated with it. Sessions can be saved and resumed, and they can be shared between clients.

Retryable actions

To account for the fact that sometimes actions fail because of mysterious reasons, Selenate has support for automatic action retrying (until the action succeeds, for a maximum of a specified number of retries).

Frame and window management

Client code doesn't need to worry about switching between frames and windows, Selenate can manage them automatically.

Keepalive

For sessions that require constant activity to remain active (auto log-out), Selenate can automatically and periodically execute a specified set of commands, to prevent session from expiring.

Browser pool

Selenate supports a browser pre-loading for faster session initialization.

Session recording

Selenate can record a video of the entire scraping session for debugging purposes.

Robot and Sikuli support

Selenate has a support for native mouse and keyboard actions, as well as Sikuli integration.

Java Applet support

Selenate supports working with Java applets embedded in web pages.

Versions

Version
0.3.13
0.3.12
0.3.11
0.3.10
0.3.9
0.3.8
0.3.7