近基于 selenium 写了一个 python 小工具,记录下学习记录,自己运行的环境是 Ubuntu 14.04.4 , Python 2.7 , Chromium 49.0 , ChromeDriver 2.16
selenium简介
selenium提供了一个通用的接口,可模拟用户来操作浏览器,比如用于自动化测试等.
selenium的核心是 WebDriver ,它提供了一组接口,这些接口能够操作各种跨平台的浏览器.
各大浏览器厂商.
各大浏览器厂商也支持Selenium,将其作为浏览器的一部分.
selenium 工具集提供了 WebDriver , Selenium IDE , Selenium-Grid 等
Selenium 1.0 + WebDriver = Selenium 2.0
Selenium WebDriver 是 Selenium Remote Control(Selenium-RC) 的继承者.
· WebDriver 提供了更简单和简洁的接口,克服了 Selenium-RC API 一些限制.
· 相比 Selenium 1.0 , WebDriver 是面向对象式的服务.
· WebDriver 驱动浏览器更有效率,提供了比 Selenium 1.0 更多的功能
· Selenium RC 只能在单机上运行, WebDriver 则提供了远程操作的功能
selenium基本使用
selenium运行需要什么
主要包括三部分: selenium selenium , 浏览器driver , 浏览器
selenium selenium 是一组通用的接口,而不同的浏览器提供其自身的 driver (大部分是官方的),浏览器则被模拟控制操作的终端.
安装
pip install selenium --upgrade
apt-get install chromium-browser
wget http://chromedriver.storage.googleapis.com/2.10/chromedriver_linux`getconf LONG_BIT`.zip
unzip chromedriver_linux32.zip
cp chromedriver /usr/local/share
chmod +x /usr/local/share/chromedriver
ln -s /usr/local/share/chromedriver /usr/local/bin/chromedriver
ln -s /usr/bin/chromedriver /usr/local/share/chromedriver
简单的使用
from selenium import webdriver
driver = webdriver.Chrome('/usr/local/bin/chromedriver')
driver.get('http://mail.sina.net');
print(driver.title)
API使用
可参考 /usr/local/lib/python2.7/dist-packages/selenium
Chrome WebDriver
selenium.webdriver.chrome.webdriver.WebDriver(executable_path='chromedriver', port=0, chrome_options=None, service_args=None, desired_capabilities=None, service_log_path=None)
ChromeOptions
可以通过 ChromeDriver session 配置 ChromeDriver session
ChromeDriver convenient methods for setting ChromeDriver-specific capabilities
from selenium.webdriver.chrome.options import Options
chrome_options = Options()
chrome_options.add_argument("--disable-extensions")
chrome_options.add_argument('--disable-logging')
chrome_options.add_experimental_option('prefs', {'download.default_directory':
'/tmp'})
chrome_options.binary_location='/usr/bin/chromium-browser'
driver = webdriver.Chrome(chrome_options=chrome_options)
直接使用DesiredCapabilities
ChromeOptions是构建在DesiredCapabilities之上的,为了使用DesiredCapabilities,必须
知道capability的Key/value对.
chrome_options = Options()
capabilities={}
capabilities['platform'] = "WINDOWS"
capabilities['version'] = "10"
capabilities.update(chrome_options.to_capabilities())
driver = webdriver.Chrome(desired_capabilities=capabilities)
chromedriver运行方式
The ChromeDriver class 不断的创建实例,会浪费很多的时间,可以通过两个方式解决.
使用ChromeDriverService
import selenium.webdriver.chrome.service as service
service = service.Service('/usr/bin/chromedrive')
service.start()
capabilities = { }
driver = webdriver.Remote(service.service_url, capabilities)
driver.get('http://mail.sina.net');
print(driver.title)
开启单独的ChromeDriver服务
./chromedriver
driver = webdriver.Remote('http://127.0.0.1:9515', DesiredCapabilities.CHROME)
driver.get('http://mail.sina.net');
RemoteWebDriverServer
The RemoteWebDriver is composed of two pieces: a client and a server. The client is your WebDriver test and the server is simply a Java servlet, which can be hosted in any modern JEE app server. The server will always run on the machine with the browser you want to test.
wget http://selenium-release.storage.googleapis.com/2.53/selenium-server-standalone-2.53.0.jar
java -jar selenium-server-standalone-2.53.0.jar
from selenium import webdriver
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities
driver = webdriver.Remote( command_executor='http://127.0.0.1:4444/wd/hub',des
desired_capabilities=DesiredCapabilities.CHROME)
driver.get('http://mail.sina.net');
其他
参考网站:
官方网站 , 官方github
ChromeDriver
Python api
Selenium非官方文档
used pyvirtualdisplay to simulate a display:
由于使用的是Ubuntu服务器版,所以无法运行chrome,通过pyvirtualdisplay解决该问题
sudo apt-get install Xvfb
sudo pip install pyvirtualdisplay
from pyvirtualdisplay import Display
display = Display(visible=0, size=(1024, 768))
display.start()
driver = webdriver.Chrome('/usr/local/bin/chromedriver')
driver.get('http://mail.sina.net');
print(driver.title)
display.stop()
Explicit Wait:
由于是模拟用户操作浏览器,浏览器加载需要时间,为确保成功加载完成才继续执行下去,解决方案如下
from selenium.webdriver.support.ui import WebDriverWait
driver = webdriver.Chrome()
driver.get('http://mail.sina.net/login');
el = WebDriverWait(driver, 10).until(lambda x: x.find_element_by_id("loginfromemail"))
print(el.text)