How to configure R53 so that Lambda and EC2 uses an internal DNS value # DNS resolution on the network will go through 3 steps to determine which service is authoratitive for a lookup Private DNS (the main point of this post) VPC DNS (e.g. for an instance name) Public DNS Route 53 has a concept of Resolvers that allow fine grained control of where DNS lookups are routed. ...
I received the following error when testing out a simple data join in AWS Glue. AnalysisException: 'Cannot resolve column name "customer_id" among ();' Interestingly It did not appear on the first run of the job It did not appear if I used an INNER join, just LEFT/RIGHT It did not appear if running in a jupyter notebook (which is the same as a 1st time run) Tl/DR - Quick solution # The issue is caused because job was set with Bookmarks ‘Enabled’. ...
What is it ..? # Azure Databricks is Azure’s cloud hosting of Databricks. Databricks is ‘Spark for the cloud’. Spark, or Apache Spark is a data engine for large scale data processing. in other words … you have some data, lots of data that is stored in one or more places (think flat files, streams, traditional db …). You need to do some processing on that data. ...
For a site with low throughput, paying for a comments feature seems nonsensical. This site is super cheap to run as it is hosted on AWS S3 static hosting model. I like and want to keep it that way. So, when looking to add a comment feature the obvious (to me) choice was to see if I could roll my own and learn a little along the way. This post covers the AWS Architecture for running a comment feature set and notes to future self so that I remember how it is put together. ...
Types of AAD tenants # Azure Active Directory This will be the main usage scenario for most people This directory can manage: on-premises accounts, synced by AAD Connect from Active Directory cloud native accounts (created and only present in AAD) guest accounts (B2B) Azure Active Directory B2C Used to manage a directory of users that have access to the same resource, typically an app Not for access to apps such as O365 (that would be a standard AAD tenant) Types of users # These appear in the Azure AD (AAD) user list. ...
Moving to the lovely book template raised a few learning points. They’re captured here as they took a while to sink in. All items relate to a Hugo blog config.toml controls which template is active theme = '<name of theme> the theme string is a reference to a folder in the ‘themes’ folder in the blog directory. You can rename the directory and update the theme reference in config.toml The following items relate to the book theme ...
The diagram below has been produced by the draw.io app that is Available either: As a native (javascript) app in the browser: https://app.diagrams.net/ As a desktop app (javascript) Embedded in a confluence page These diagrams: Store the data locally, not on a server offering data privacy / protection: https://drawio-app.com/drawio-data-protection/ either as xml files in the browser or hard drive / one-drive embedded in the confluence page This article covers a quick way to produce dependency / hierarchy diagrams such as the one on the above. ...
A set of useful links # AWS Stash : A collection of AWS stuff in an easy to search interface. 101 GitHub Repos : Absolute List Of Useful Repos
2020 books January The spy who came in from the cold - John Le Carré [A] Twas The Nightshift Before Christmas - Adam Kay A Walk In The Woods - Bill Bryson February We have always lived in the castle - Shirley Jackson Dune - Frank Herbert [A] March Gold Mine - Wilbur Smith The Oxygen Advantage - Patrick McKeown Pine - Francine Toon April ...
Some ‘tips’ on certs, mainly applies to Windows presentation File differences # all these contain the public format only CRT - This tells you nothing. It can hold a binary (DER) or base64 (PEM) format contents CER - As for CRT, this tells you nothing, can be Base64 or DER (binary) format. PEM - this is a Base64 ASCII encoded file. In windows you can rename PEM to CRT and windows will show it fine. ...