Skip to main content

All Questions

Tagged with
0 votes
1 answer
37 views

Extracting the text between span tags in a Javascript-rendered page using Selenium in Python

I am trying to scrape all instances of text between tags with a particular class on a web page that dynamically updates. I am using selenium with a chrome WebDriver in Python. In a normal browser, ...
zicari's user avatar
  • 5
0 votes
0 answers
24 views

Extract all data inside g tag of JS chart using Selenium

I am currently trying to scrape a local web page, generated by my EV charger. I access it through it's IP address, which requires me to sign in. After signing in, I want to retrieve the data from the ...
DvdV's user avatar
  • 77
0 votes
1 answer
82 views

click() method from element object (HtmlUnit) is doing nothing

I am trying to crawl on this website: https://www.softpedia.com/get/Programming/Other-Programming-Files/Apidog.shtml using html unit. I want to "click" on "Download now" button, it ...
Daniel Reuveni's user avatar
-1 votes
1 answer
156 views

How to locate an element by Xpath/CSS selectors using Playwright

How to locate an element by Xpath/CSS selectors using Playwright TS/JS? There are many locators in Playwright (in comparison to Selenium) such as getByRole and getByText. Is there any locator like ...
I.sh.'s user avatar
  • 1,325
1 vote
1 answer
36 views

XPath exclude child similar elements

How can I select all elements by attribute name but exclude child elements that are identical using XPath? HTML <div c-store="test"> <div c-text>Product Name</div> ...
webifo's user avatar
  • 23
2 votes
1 answer
172 views

XPath Selector in Puppeteer 22.x

I have read the newest Puppeteer v22.x documentation about XPath, still don't know how to use XPath in Puppeteer 22.x. I want to click an element containing the text 'Next'. Here the HTML that has the ...
Ruzky's user avatar
  • 157
0 votes
1 answer
60 views

Javascript can't find certain existing element

I'm on writing a Javascript, which should find consent banner buttons and click on the buttons like "accept all cookies". My code works for multiple sites, here is it: function ...
Evgeniy's user avatar
  • 2,491
1 vote
0 answers
23 views

DOMException: Failed to execute 'evaluate' on 'Document': The string '//*[cac:Party]' [duplicate]

DOMException: Failed to execute 'evaluate' on 'Document': The string '//*[cac:Party]' contains unresolvable namespaces. const parser = new DOMParser(); const xmlDoc = parser....
estefania jaramillo's user avatar
1 vote
1 answer
29 views

Document.evalute not resolving XPath

I am tring to use Document.evaluate to extract XPath values from an XML document. However for some reason the return value is always blank. The XML document uses namespaces, so I am passing a ...
Andrew Tyson's user avatar
0 votes
1 answer
44 views

Xpath of element based only in text content?

I'm trying to get the xpath of the second button "buy" for this HMTL code, but without using class, id nor other attribute nor full Xpath, only the text content relative to it like in this ...
Rasec Malkic's user avatar
0 votes
2 answers
42 views

Javascript Document.evalute failing with 'name()' in XPath

I am attempting to use the Javascript Document evaluate function with valid XPath that uses the name() / local-name() function but am consistently getting the following error in Jfiddle: The string '/...
Andrew Tyson's user avatar
0 votes
1 answer
299 views

Wait using Path (Puppeteer)

I'm using Puppeteer 22.6.0 with NodeJS for web scraping, I'm trying to pause the script until a specific h1 element is visible, the issue is there are multiple h1 elements on the page and the only ...
Omar's user avatar
  • 123
1 vote
1 answer
40 views

select div conditionally using xpath

I want to select a div only when the condition is satisfied/valid. The following div can be present in 2 ways(button will be enabled/disabled) when loading the html. Enabled button state: <div ...
kajezevu's user avatar
0 votes
1 answer
45 views

How can I find a relative xpath for buy button

I want to find the xpath of the buy button. I created the paths using copying through chrome but they are not working on everypage of the website where I require them to work. I require a path such ...
kajezevu's user avatar
2 votes
0 answers
47 views

Shadow DOM | airship-html-prompt-shadow | I'm not able to get in shadow DOM elements to click on buttons [closed]

I'm having trouble finding the correct XPaths to click the "No, Thanks" and "Yes, Subscribe me!" buttons in the provided Airship HTML prompt. I've reviewed the documentation https:/...
Zeeshan 's user avatar

15 30 50 per page
1
2 3 4 5
98