Spider unreliable for pixelambacht.nl

[zachleat]

Compare the following two outputs:

~/Code/glyphhanger (master ✘)✭ ᐅ node index.js https://pixelambacht.nl --spider --spider-limit=11 --verbose
glyphhanger-spider found (1): https://pixelambacht.nl/
glyphhanger-spider found (2): https://pixelambacht.nl/2016/font-awesome-fixed/
glyphhanger-spider found (3): https://pixelambacht.nl/2016/blackout/
glyphhanger-spider found (4): https://pixelambacht.nl/2016/comicsans-conf/
glyphhanger-spider found (5): https://pixelambacht.nl/2016/building-bixa-color/
glyphhanger-spider found (6): https://pixelambacht.nl/2015/sans-bullshit-sans/
glyphhanger-spider found (7): https://pixelambacht.nl/2014/compyx-a-multicolor-8bit-font/
glyphhanger-spider found (8): https://pixelambacht.nl/2014/multicolor-fonts/
glyphhanger-spider found (9): https://pixelambacht.nl/2014/multicolor-icons/
glyphhanger-spider found (10): https://pixelambacht.nl/2013/css3-c64/
glyphhanger-spider found (11): https://pixelambacht.nl/2013/font-face-render-check/
glyphhanger requesting: https://pixelambacht.nl/
glyphhanger requesting: https://pixelambacht.nl/2016/font-awesome-fixed/
glyphhanger requesting: https://pixelambacht.nl/2016/blackout/
glyphhanger requesting: https://pixelambacht.nl/2016/comicsans-conf/
glyphhanger requesting: https://pixelambacht.nl/2016/building-bixa-color/
glyphhanger requesting: https://pixelambacht.nl/2015/sans-bullshit-sans/
glyphhanger requesting: https://pixelambacht.nl/2014/compyx-a-multicolor-8bit-font/
glyphhanger requesting: https://pixelambacht.nl/2014/multicolor-fonts/
glyphhanger requesting: https://pixelambacht.nl/2014/multicolor-icons/
glyphhanger requesting: https://pixelambacht.nl/2013/css3-c64/
glyphhanger requesting: https://pixelambacht.nl/2013/font-face-render-check/
glyphhanger output (115):

 !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]_abcdefghijklmnopqrstuvwxyz{|}×ü‑–—‘’“”…™↩◻✓

~/Code/glyphhanger (master ✘)✹✭ ᐅ node index.js https://pixelambacht.nl --spider --spider-limit=12 --verbose
glyphhanger-spider found (1): https://pixelambacht.nl/
glyphhanger-spider found (2): https://pixelambacht.nl/2016/font-awesome-fixed/
glyphhanger-spider found (3): https://pixelambacht.nl/2016/blackout/
glyphhanger-spider found (4): https://pixelambacht.nl/2016/comicsans-conf/
glyphhanger-spider found (5): https://pixelambacht.nl/2016/building-bixa-color/
glyphhanger-spider found (6): https://pixelambacht.nl/2015/sans-bullshit-sans/
glyphhanger-spider found (7): https://pixelambacht.nl/2014/compyx-a-multicolor-8bit-font/
glyphhanger-spider found (8): https://pixelambacht.nl/2014/multicolor-fonts/
glyphhanger-spider found (9): https://pixelambacht.nl/2014/multicolor-icons/
glyphhanger-spider found (10): https://pixelambacht.nl/2013/css3-c64/
glyphhanger-spider found (11): https://pixelambacht.nl/2013/font-face-render-check/
glyphhanger-spider found (12): https://pixelambacht.nl/lapislegit
glyphhanger requesting: https://pixelambacht.nl/
glyphhanger requesting: https://pixelambacht.nl/2016/font-awesome-fixed/
glyphhanger requesting: https://pixelambacht.nl/2016/blackout/
glyphhanger requesting: https://pixelambacht.nl/2016/comicsans-conf/
glyphhanger requesting: https://pixelambacht.nl/2016/building-bixa-color/
glyphhanger requesting: https://pixelambacht.nl/2015/sans-bullshit-sans/
glyphhanger requesting: https://pixelambacht.nl/2014/compyx-a-multicolor-8bit-font/
glyphhanger requesting: https://pixelambacht.nl/2014/multicolor-fonts/
glyphhanger requesting: https://pixelambacht.nl/2014/multicolor-icons/
glyphhanger requesting: https://pixelambacht.nl/2013/css3-c64/
glyphhanger requesting: https://pixelambacht.nl/2013/font-face-render-check/
glyphhanger requesting: https://pixelambacht.nl/lapislegit
glyphhanger output (110):

 !"#%'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]_abcdefghijklmnopqrstuvwxyz{|}×–—‘’“”…™↩✓

Note how the second request has more test urls (correct) but fewer glyphs in the output (likely

[zachleat]

Maybe @RoelN can weigh in on if one of these test URLs is doing something nondeterministic.

[RoelN]

I'm thinking https://pixelambacht.nl/lapislegit is to blame. I'm doing lots of weird stuff on that page (e.g. SVGs with embedded iframes). I don't have time to dig deeper now, but check:

➤ glyphhanger https://pixelambacht.nl/lapislegit

 !"#%'(),-./0123456789:;<=@ABCDEFGHIJLMNOPQRSTUVWXYabcdefghijklmnopqrstuvwxyz{}

➤ glyphhanger https://pixelambacht.nl/lapislegit --spider --spider-limit=10
ReferenceError: Can't find variable: jstest1

  https://pixelambacht.nl/lapislegit/src/svg/0045.svg:6 in global code

 !"#%'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPRSTUVWXY[]_abcdefghijklmnopqrstuvwxyz{|}×–—‘’“”…✓

/Volumes/vice-macosx-cocoa-i386+x86_64-10.6-gcc42-2.4/tools 20:15:27

[zachleat]

Ahhh, ok great—thank you @RoelN. I’ll close this for now as an edge case. Reopen if you see anything else weird going on!