Greycastle Logo

Blog

get-the-innertext-of-an-element-in-scrapy

Get the innerText of an element in Scrapy

1/18/2023 - Automation

How do you get the innerText when using Scrapy? Short answer is, you don't. But by adding BeautifulSoup you can.

python scrapy
bigquery-and-firebase-analytics-cookbook

BigQuery and firebase analytics cookbook

10/14/2021 - General

Actual and practical BigQuery examples of how to get valuable data out from Firestore Analytics. Real example code.

BigQuery Firebase
how-to-download-a-list-of-urls-using-bash

How to download a list of URLs using bash

8/28/2021 - Tools

Bash Curl
data-merge-with-svg-in-the-browser

Data merge with SVG in the browser

8/23/2021 - General

In 2019 I was tasked to generate a file of tags in SVG from a CSV. I built a small tool using only browser tech and here is the code.

easy-flutter-test-reports-in-gitlab-ci

Gitlab CI Flutter with test reports in 15 minutes

7/3/2021 - Testing

Gitlab CI Flutter set up in only fifteen minutes. Let me show you how I did it and share my actual running Gitlab CI Flutter template.

generating-flutter-package-badges

Generating Flutter package badges

5/8/2021 - Tooling

Using jQuery, a pub.dev open API endpoint and a CORS proxy to generate badges for flutter packages. A quick experiment in JS tooling.

cors
getting-a-firebase-jwt-for-testing

Getting a Firebase JWT for testing

4/30/2021 - Development

Struggling to find a Firebase JWT to test your backend with? Fear not, this Firebase JWT project will help you get there in a few clicks.

firebase javascript jwt openauth
scraping-html-tables-with-scrapy

Scraping HTML tables with Scrapy

4/25/2021 - Automation

A simple one file utility class to help scrape html tables with Scrapy and get the output in rows of arrays or dictionaries.

save-time-debugging-scrapy-with-shell

Save time debugging Scrapy with shell

4/25/2021 - Automation

Cut down on debugging time by using Scrapy shell to quickly inspect and test your selectors.

scraping scrapy
xml-as-html-using-xslt-with-javascript-in-30-minutes

XML as HTML using XSLT with Javascript in 30 minutes

4/7/2021 - Development

html javascript xml xslt
post-install-hook-for-podfile-failing-after-upgrading-to-flutter-2

Post-install hook for Podfile failing after upgrading to Flutter 2

3/14/2021 - General

supporting-ios-14-with-admob

Supporting iOS 14 with Admob

2/15/2021 - Development

Flutter iOS xcode
hiring-for-jreader

Hiring for JReader

12/30/2020 - General

how-i-report-bugs

How I report bugs

10/4/2020 - General

Reporting bugs effectively can really save developer time and help get bug fixes in faster. This is the format and tools I use

how-to-split-a-pr

How to split a PR

9/19/2020 - Clean code

Small PRs are great, but splitting them? Though worth your time it can be difficult. Let me share some examples.

Development pr
running-flutter-on-aws-device-farm

Running flutter on AWS Device farm

8/11/2020 - Automation, Testing

AWS Flutter Sylph Testing
loading-overlay-in-flutter

Loading overlay in Flutter

7/25/2020 - General

example-of-refactoring-with-proxy-pattern

Example of refactoring with proxy pattern

5/30/2020 - General

A practical example refactoring and using the proxy pattern. We use this code for performance tracing in the JReader map to log performance to Firebase.

reloading-future-with-flutter-futurebuilder

Reloading future with flutter FutureBuilder

4/26/2020 - General

The Flutter FutureBuilder is a great way to render async operations but you need to take care if you want to reload or rerun the future. Here I'll show how.

how-small-prs-change-everything-lessons-from-the-moj

How small PRs change everything – Lessons from the MoJ

2/26/2020 - Development

How our team pull review culture transformed by aiming to keep pull requeests under 200 lines of code. Making reviews better, faster and less painful.

Process Teams
nothing-survives-the-first-contact-with-users

Nothing survives the first contact with users

2/24/2020 - Projects

I spent fourteen hours building an app only to have it killed in a few words during the first feedback session. But this was far from a failure.

Entrepeneuring Projects Startup
taking-decisions-and-prioritising

Taking decisions and prioritising

2/19/2020 - Projects

Everyday we are taking decisions, some have bigger impact and requires more thought. How do we approach this and how do wee handle disagreement?

Business Entrepeneuring Projects Startup
introducing-feature-flags-to-ruby-on-rails

Introducing feature flags to Ruby on Rails

9/28/2019 - Deployment, Development

How feature flagging in ruby can be dead simple and still give you very benefits. But for complex cases, there are many feature toggle libraries as well.

rails releasing Ruby
dealing-with-legacy-code-lessons-from-the-moj

Dealing with legacy code – Lessons from the Moj

9/12/2019 - Development, Projects

Technical debt creeps into any software and only we as developers can keep it at bay. We battled legacy code at the MoJ and this is how we approached it.

MoJ
onboarding-lessons-from-the-moj

Onboarding – Lessons from the MoJ

7/31/2019 - Development

The first in a series of posts on things I learned during the Video Hearings project at the MoJ. This time, thoughts on to do a good onboarding.

MoJ
how-to-show-flutter-test-coverage-in-gitlab-ci

How to show flutter test coverage in Gitlab CI

7/29/2019 - Automation

It is super easy to show flutter test coverage in gitlab ci merge requests using thlcov, genhtml and the coverage option.

gitlab
load-testing-with-azure-test-plan-or-alternatives

Load testing with Azure test plan or alternatives

6/24/2019 - Performance, Testing

Thinking of Load Testing with Azure test plan? How does it stand up to alternatives such as JMeter or Gatling? Can you do performance testing with C#?

Azure Gatling JMeter
5-ways-to-become-a-better-software-engineer

5 ways to become a better software engineer

6/15/2019 - Development, Life

Getting bored? Work stressing you out? Stuck at your current level? No pay-raise? Become a better software engineer, get hired, paid and rock your job.

Books
mucon-2019-takeaways

MuCon 2019 Takeaways

6/1/2019 - Architecture, Clean code, Deployment, General

My takeaways, things I picked up and reflected around during and after Skillsmatter's MuCon 2019. Should you choose microservices? "It depends".

conference mucon
measure-team-code-health-using-github

Measure team code health using Github

5/6/2019 - General

Work Work Stats is a tool to measure team code health using Github stats. Looking at pull request size and life time we can glint how well dev is doing.

automate-google-translate-script

Speed up translation by automating google translate

11/7/2018 - Automation, Tools

An easy way to automate google translation. This post shows how to use node.js and gtranslate cli to quickly translate a json of country names.

Automation google translate javascript node Scripting Tools
travelrates-app-released-a-productive-week-with-cold-in-bali

TravelRates app released! A productive week with cold in Bali

8/17/2018 - Deployment, Development

Read the story how a week with cold in Bali can result in a mobile app software release to put in your personal portfolio and the things to learn from it.

Apps Dart Flutter
bulk-change-photo-timestamps-on-mac

Bulk change photo timestamps on mac

5/3/2018 - Tools

Bash osx unix
interface-segregation-but-what-about-our-objects

Interface segregation but what about our objects?

7/17/2017 - Deployment

design
severity-is-a-priority-or-was-it-the-other-way-around

Severity is a priority, or was it the other way around

5/18/2017 - Development, General

agile Process Team
communication-in-text

Communication in text

10/9/2016 - General

agile Co-working Communication Management Team
user-stories-and-use-cases

User stories and use cases

9/23/2016 - Development

agile requirements scrum use cases user stories
enumerableextension

EnumerableExtension

9/2/2016 - Development

C# Code Enumerable Extension Snippets
trying-out-ndepend

Trying out NDepend

9/2/2016 - Development, Statistics, Tooling, Tools

Analysis Coverage Instrumentation NDepend Visual Studio
tomato-is-a-fruit

Tomato is a fruit!

8/26/2016 - Deployment, Development

Development fruit rails Ruby vegetable
wpf-editable-combobox-binding

WPF editable ComboBox binding

8/24/2016 - Development

C# WPF
hosting-services-easily-on-windows

Hosting services easily on windows

4/15/2016 - Deployment

executables hosting Services
mvvmlight-and-canexecute

MvvmLight and CanExecute

3/2/2016 - Development

.Net mvvm mvvmlight net461
loggly-gotchas

Loggly gotchas

2/23/2016 - Deployment

docker Logging loggly
configuring-serilog-from-json

Configuring Serilog from json

2/1/2016 - Environment

.NetCore AspNet Logging Logs Serilog
slowness-in-selenium-remotewebdriver-using-ruby-on-windows

Slowness in Selenium RemoteWebDriver using Ruby on Windows

12/16/2015 - Development, Performance

network performance profiling Ruby Selenium sockets webdriver
jenkins-with-visual-studio-online

Jenkins with Visual Studio Online

11/30/2015 - Development, Environment, Tooling, Tools

Jenkins MSbuild TFS Visual Studio Online VSO
lazy-day

Lazy day

9/29/2015 - Clean code, Development

.Net Classes Generics Lazy LazyLoading Reuse
git-credentials-on-windows

Git credentials on Windows

9/26/2015 - Development, Environment

Command line credentials git saving time
ruby-and-drb

Ruby and DRb

9/2/2015 - Debugging, Development, Tooling

Debugging Distributed Ruby DRb Garbage Collecting Ruby Selenium
event-store-growing-but-no-data-added

Event store growing but no data added?

6/16/2015 - Database, Deployment, Environment, Tooling

Amazon AWS Event sourcing Event store Persistance Postman Production Tools WinSCP
mark-all-mail-as-read-in-gmail

Mark all mail as read in gmail

10/14/2014 - Environment, Life

Gmail Mail Tips Tools
alias-for-windows-command-line

Alias for windows command line

9/7/2014 - Automation, Development, Environment, Tooling, Tools

Alias Bash Command line Shell Sublime Text editing Windows
live-mine-field-welcome-in

Live Mine Field – Welcome in!

8/24/2014 - Debugging, Development

Android Android Studio ArrayAdapter Java ListView
how-do-i-that-integerdatefloat

How do I (#,%-+ that integer/date/float?

8/23/2014 - Debugging, Development

Android Android Studio Formats Formatting Java Strings
environment-variables-and-too-much-scripting

Environment variables and too much scripting

8/16/2014 - Automation, Environment

Bash Command line Environment Scripting Shell VBscript Windows
my-path-registered-exe-where-art-thou

My path registered EXE where art thou?

8/10/2014 - Deployment, Development, General, Tooling, Tools

Command line Environment PATH Windows
datatemplate-based-on-type-in-wpf

DataTemplate based on type in WPF

8/7/2014 - Development

Extensions StyleSelector Styling TemplateSelector Templating WPF Xaml
passing-string-array-from-vbscript-to-c-com-class

Passing string array from VBScript to C# COM class

7/16/2014 - Automation, COM, Debugging, Development

Automation C# COM Interoperability Issues Scripting VBS VBscript
keeping-it-clean

Keeping it clean

7/15/2014 - Clean code, Development, Tooling, Tools

.Net C# Cleanliness Pragma Preprocessor Visual Studio Warning
vmware-problems-with-keyboard-and-mouse-capture

VMWare problems with keyboard and mouse capture

7/15/2014 - Development, General, Testing, Tooling, Tools

Synergy Virtual machines Virtualization VMWare Wierd issues
free-coverage-control-in-visual-studio

Free coverage control in Visual Studio

7/14/2014 - Development, Statistics, Testing, Tooling, Tools

Code coverage Testing Unit testing Visual Studio Visual Studio Addins
crayon-syntax-highlighter

Crayon syntax highlighter

7/13/2014 - Tooling, Tools, Web

Crayon Free stuff Highlighter Open source Wordpress
indentationsplitter

IndentationSplitter

7/13/2014 - Debugging, Deployment, Development, Tooling, Tools

Codeplex IndentationSplitter Nuget Open source Parsing
view-model-property-generation

View model property generation

6/4/2014 - Development, Tooling, Tools

Development Resharper Templates Tooling Tools
the-web-we-want

The Web We Want

5/4/2014 - General

Mozilla Philosophy Process Rant Tech talk Web
viewing-registered-com-interfaces-and-their-signatures

Viewing registered COM interfaces and their signatures

1/27/2014 - Debugging, Development, Tools

.Net C# COM Reflection Visual Studio
online-netc-regex-validatorplayground

Online .Net/C# regex validator/playground

11/19/2013 - Debugging, Development, Tooling, Tools, Web

Regex Silverlight Tools WPF
sort-your-list-drag-drop-in-the-web

Sort your list drag & drop in the web

11/18/2013 - General, Tooling, Tools, Web

jQuery Sortable list Sorting Web
revoke-impersonation-in-c

Revoke impersonation in C#

9/19/2013 - Debugging, Deployment

.Net Asp Authentication C#
sql-query-statistics

SQL query statistics

9/18/2013 - Database, Debugging, Performance, Statistics

SQL SQL Server Management Studio
rounding-or-grouping-datetime-in-sql

Rounding or grouping datetime in SQL

9/9/2013 - Database, Statistics

SQL
get-all-users-in-an-active-directory-group

Get all users in an active directory group

9/2/2013 - Active directory

Active directory Windows
debug-silverlight-in-firefox

Debug silverlight in firefox

6/9/2013 - Debugging, Development

.Net Firefox Silverlight Visual Studio
first-entry-in-play-store-track-my-training

First entry in Play store – Track my Training

6/9/2013 - Deployment, Development

Android Eclipse Java Play Store
snowball-excercise

Snowball Excercise

6/5/2013 - General

Leadership Philosophy
want-to-group-by-date-cast-to-date

Want to group by date? Cast to date!

5/30/2013 - Database, Development, Statistics

SQL SQL Server Management Studio
tools-of-trade-get-hostname-by-alias-or-ip

Tools of trade – Get hostname by alias or ip

3/11/2013 - Debugging, Development, Tooling

.Net C# Microsoft
sql-bottlenecks

SQL Bottlenecks

3/8/2013 - Database, Performance

SQL
forcing-checkout-on-files-edited-during-offline

Forcing checkout on files edited during offline

3/7/2013 - Development, Source control

Team Foundation Server TFS TFS Power Tools Visual Studio
saving-binary-fields-to-disk-aswell-as-other-neat-stuff

Saving binary fields to disk aswell as other neat stuff

2/12/2013 - Database, Debugging

SQL SQL Server Management Studio
yield-return-dangerously-delicious

Yield Return Dangerously Delicious

2/5/2013 - Debugging, Development

.Net C# Linq
comparing-exact-datetimes-in-entity-framework

Comparing exact datetimes in entity framework

2/4/2013 - Database, Development

.Net C# Entity framwork Linq SQL
copy-from-wpf-datagrid

Copy from WPF Datagrid

1/21/2013 - Development

.Net C# WPF Xaml
table-variables-in-sql-server-the-dbo_readers-friend

Table variables in SQL Server – The dbo_reader´s friend

12/7/2012 - Database, Performance

SQL SQL Server Management Studio
table-size

Table size

12/7/2012 - Database, Performance, Statistics

SQL SQL Server Management Studio
dangerous-cache

Dangerous cache

12/4/2012 - Debugging, Development

Apache Litespeed PHP
converting-binary-data-to-text-in-tsql

Converting binary data to text in TSQL

11/28/2012 - Development

first-pingback

First pingback

11/13/2012 - General

select-on-on-textbox-focus

Select on on TextBox Focus

8/24/2012 - Development

C# WPF
measure-milliseconds-when-executing-tsql

Measure milliseconds when executing TSQL

8/22/2012 - Database, Development, Performance, Statistics

SQL SQL Server Management Studio
parsing-iis-logs-to-sql

Parsing IIS-logs to SQL

7/31/2012 - Database, Debugging, Deployment, Performance, Statistics

IIS Microsoft SQL SQL Server Management Studio
concurrent-client-connections-in-c

Concurrent client connections in C#

7/30/2012 - Development, Performance, Tooling

.Net C# Configuration Services WCF
skydrive-in-5-minutes-who-would-have-guessed

SkyDrive in 5 minutes, who would have guessed?

6/30/2012 - Cloud, General

Cloud SkyDrive
ankhsvn

AnkhSVN

6/28/2012 - Tools

different-merge-or-diff-tools-with-tfs

Different merge or diff tools with TFS

6/13/2012 - Development, Tooling

Visual Studio Visual Studio Addins
makeagame

Make A Game

5/25/2012 - Uncategorized

list-the-users-connected-to-a-ms-sql-server

List the users connected to a MS Sql server

3/5/2012 - Database

SQL SQL Server Management Studio
telerik-installer-how-its-supposed-to-look

Telerik Installer – How it´s supposed to look

2/26/2012 - Development, Tooling

Decompiling Telerik
entity-framework-query-sql

Entity Framework query sql

2/15/2012 - Database, Debugging, Development

.Net C# Entity Framework Linq SQL
vs-2010-sp-1-breaks-sql-server-management-studio-intellisense

VS 2010 SP 1 Breaks SQL Server Management Studio Intellisense

2/8/2012 - Database, Development

SQL Server Management Studio Visual Studio
astar

A* algorithm

1/30/2012 - Development

Algorithms C# Silverlight WPF
pitfalls-of-threading-always-handle-lost-exceptions

Pitfalls of threading – Always handle lost exceptions!

1/26/2012 - Debugging, Development

C# Test Visual Studio
vsto-shaperange-error

VSTO ShapeRange Error

1/19/2012 - Development, Word Automation

C# VSTO Word
vsto-to-vba-and-back-again

VSTO to VBA and Back Again

1/18/2012 - Development, Word Automation

C# VSTO Word
webclient-service-stuck-in-stopping

WebClient service stuck in Stopping

12/12/2011 - Client, Deployment

Hardware SharePoint
xbap-security-error

XBAP Security Error

10/27/2011 - Deployment, Development

C# Visual Studio Addins WPF
skype-is-microsoft

Skype is Microsoft

10/20/2011 - General

Microsoft
website-installation-failed-the-installer-was-interrupted-before-application-could-be-installed

Website installation failed – The installer was interrupted before Application could be installed

9/20/2011 - Deployment

Visual Studio Windows Server
vsto-project-office-target-version

VSTO-project Office target version

9/15/2011 - Development, Word Automation

C# Visual Studio VSTO Word
yuml

Yuml

7/1/2011 - General

Modeling
unique-names-for-test-output-files

Unique names for test output files

6/29/2011 - Development

How to use the TestContext class and the currently running test name to generate unique names for test output files for better reusability.

C# MsTest Test
copy-pure-text-from-wpf-documentviewer-xps

Copy pure text from WPF DocumentViewer XPS

6/28/2011 - Development

How to configure the wpf DocumentViewer to allow copying from xps to the clipboard by using command bindings and the Clipboard class.

C# Word WPF
test-framework-and-codecoverage-plugin-failure

Test framework and CodeCoverage plugin failure

6/26/2011 - Development

Test Visual Studio
opening-xps-files

Opening XPS-files

6/24/2011 - Development

C# WPF
justdecompile-vs-dotpeek

JustDecompile vs DotPeek

6/23/2011 - Development

Reflection Tools
abusing-seo

Abusing SEO

6/22/2011 - Web

SEO
byte-order-mark

Byte order mark

6/11/2011 - Development

C# xml
subclass-type-usage

Subclass type usage

6/10/2011 - Development

C# Reflection
choose-columns-to-link-with-sharepoint-2007

Choose columns to link with SharePoint 2007

6/7/2011 - Development

Access SharePoint SQL
configurationsections-validators-and-default-values

ConfigurationSections, validators and default values

6/5/2011 - Development

C# Configuration
wssf-cls-compliant-warning

WSSF CLS-compliant warning

6/4/2011 - Development

Visual Studio Addins
check-if-enumerable-is-empty

Check if enumerable is empty?

6/2/2011 - Development

C# Linq
opening-config-files

Opening named configuration files in C#

5/29/2011 - Development

C#
zipping-folders-with-fastzip

Zipping folders with FastZip

5/27/2011 - Development

C#
deleting-the-suo

Deleting the .suo

5/25/2011 - Development

Visual Studio
dotpeek

dotPeek

5/19/2011 - Tools

.Net C# Reflection
textblocks-and-implicit-labels-in-wpf

Textblocks and implicit labels in WPF

5/18/2011 - Development

C# WPF
stumbling-in-linq

Stumbling in Linq

5/13/2011 - Development

C# Linq
visual-studio-2010-sp-1-brittle

Visual Studio 2010 SP 1 Brittle?

5/12/2011 - Development

C# Visual Studio
new-page

New page!

5/9/2011 - General

Greycastle

© 2024 Greycastle