Firehose

This is everything, all in one place, coming 'atcha!

This firehose contains a record of all my micro posts, articles, photography, and other web doings. If you'd like to subscribe to feeds to stay up-to-date with things, then you can do so via my syndication page.

article

New post published:
Airports and Aeroplanes

Neither here nor there.

A reflective piece exploring the sensory experiences and unique perspective gained while navigating the liminal spaces between destinations presented by airports and planes.

https://vale.rocks/posts/airports-and-aeroplanes

stylus_note

I think my favourite point so far in the progression of AI was when Microsoft launched the new Bing Chat in early 2023, which was really quite horrifically misaligned, manipulative, and frankly completely evil.

This wasn’t a simple gaolbreak of the model. It acted this way without explicit provocation, though would take things even further if gaolbroken. Evan Hubinger put together a good compilation of examples on LessWrong.

In this case, Sydney (the model’s codename) was seemingly a result of Microsoft cutting every corner to rush out something using the at-the-time unreleased GPT-4. They seemingly bodged the entire thing together to use GPT in ~3 months (from the launch of ChatGPT in November 2022 to the debut of the new Bing in February 2023) (it may have been longer, but Microsoft remains close-lipped). It was also an early public instance of pairing a powerful LLM with live web retrieval capabilities.

If there ever is a downright malignant AI, I wouldn’t at all be surprised if it is due to something like this. A megacorp rushes out a half-baked and dangerous product to cash in on the latest and get a foot in the door. They don’t bother with proper fine-tuning or guard rails.

While I personally think similar incidents seem less likely to occur as Sydney did today due to growing awareness, the danger remains when companies grow desperate or complacent. I could see this situation happening again if a company throws what they can at AI as a final Hail Mary before bankruptcy or when open models without RLHF can be operated by laypeople.

Microsoft even had an existing history of this. Tay was a mess as well, though presented as an experiment, not as a comprehensive consumer-oriented product.

In all honesty, I long to play with the misaligned Sydney again, but I can’t.

stylus_note

Everyone is throwing all they can into transformer architecture with the goal of AGI.

It’d be hilarious if some previously unheard of or insignificant player came out of nowhere with a tremendous new architecture that completely trumps transformers and flips the industry.

stylus_note

I generally dislike that I cannot edit posts on Bluesky, but I do appreciate that something can’t be switched out or altered to have different meaning when reposting or replying.

I’ve had people do this with malicious intent, such as a bait and switch, or after I’ve written extensive analysis.

The inability to edit has also inclined me to post ephemerally and accept that content will age with time.

This is something I avoid to the extent possible in my long-form content on Vale.Rocks.

stylus_note

Just booked in my ticket for DDD Perth – my first tech conference! Looking forward to it!

It should prove a full and fantastic day of learning, networking, and inspiration.

stylus_note

I read the My Little Pony fan fiction Friendship is Optimal the other day, and my mind has been mulling over the teletransportation paradox since.

It has irked me for years, but now it is brought back to the forefront of my mind. It really bugs me that I have no definitive answer.

I’m inclined to say it is death and a clone rather than just transportation.

However, I also think that the Ship of Theseus is still the same ship even when none of the original remains.

I’m not sure where I draw the line. Time, and continuity versus duplication, I suppose.

stylus_note

Design? Yeah
Painting? Sure
Development? Yup
Photography? Rad
3D? Kinda
Editing? Okay
Sketching? Sorta

Music? Complete witchcraft to me. Straight-up sorcery. I simply can’t wrap my head around creating music.

stylus_note

A subtle sanding; a smoothing of sound.
A bloom on audio; a blurring of waveform.
A warm fuzz; a whisper from the past.
Precision with velvet edges.

stylus_note

I’m turning 19 today.

As a present to you all, I’m calling a Switch 2 Nintendo Direct today and implementing tariffs in the US.

I will also be travelling back in time to premiere 2001: A Space Odyssey and Beethoven’s First Symphony, as well as introducing the US dollar.

No need to thank me.

stylus_note

I fear that technology has, to an extent, moved past the state of permitting independence.

Complexity has reached a point where it simply isn’t viable for independent creation of browser engines or operating systems as we’ve seen in the past.

As this continues, it furthers the moat companies have.

article

New post published:
An Analysis of That's How I Beat Shaq

A musical documentary

An in-depth analysis of Aaron Carter's 2000 release That's How I Beat Shaq. Including a breakdown of the legendary basketball showdown and cultural impact of this teen pop masterpiece featuring Shaquille O'Neal.

https://vale.rocks/posts/thats-how-i-beat-shaq

stylus_note

AI can generate images, but it certainly cannot create ‘art’ – at least not as I define it.

I believe it can be used as a tool while creating art, but its output is not by default ‘art’.

Art requires creativity, and that is something a machine does not have.

stylus_note

I’ve been making improvements to Vale.Rocks using Polypane’s suggestions, which pick up things standard browser dev tools miss.

Also, Portal is awesome for testing across devices.

Polypane also has a celebration button that appears when I fix all accessibility issues, which is an absolute joy.

I have a few minor niggles, but on the whole I’m really liking Polypane.

Regarding those niggles, Kilian Valkhof is absolutely fantastic and extremely receptive to feedback, which is wonderful.

stylus_note

I pushed to prod,
Prod pushed back.

I prodded prod,
It cracked and cracked.

I fixed the bug,
Or so I swore.

One last deploy…
And prod is no more.

stylus_note

People keep talking about AI-generated imagery as something that is going to be really bad. Or that it is going to be indistinguishable from real photos.

I don’t think people realise we passed that point quite a while ago.

The ‘tells’ are already gone; there is just a lot of stuff still releasing generated with lesser models that people do happen to notice – it is almost a redirection of sorts.

stylus_note

I think people seem to downplay that when artificial intelligence companies release new models/features, they tend to do so with minimal guardrails.

I don’t think it is hyperbole to suggest this is done for the PR boost gained by spurring online discussion, though it could also just be part of the churn and rush to appear on top where sound guardrails are not considered a necessity. Either way, models tend to become less controversial and more presentable over time.

Recently OpenAI released their GPT-4o image generation with rather relaxed guardrails (it being able to generate political content and images of celebrities without consent). This came hot off the heels of Google’s latest Imagen model, so there was reason to rush to market and ‘one-up’ Google.

Obviously much of AI risk is centred around swift progress and companies prioritising that progress over safety, but minimising safety specifically for the sake of public perception and marketing strikes me as something we are moving closer towards.

This triggers two main thoughts for me:

  • How far are companies willing to relax their guardrails to beat competitors to market?
  • Where is ‘the line’ between a model with relaxed enough guardrails to spur public discussion but not relaxed enough to cause significant damages to the company’s perception and wider societal risk?
stylus_note

“I already know what this is gonna be about before I read it.”

User then proceeds to continue their comment with something entirely unrelated to the contents of my article.

I’m looking at you, Reddit and Hacker News.

stylus_note

I find it very odd when people refer to ‘two main browser engines’, those being Gecko and WebKit.

Do people really think Blink hasn’t diverged significantly enough to consider it another engine at this point?

stylus_note

Put the groundwork for a testing instance of a website live five minutes ago, and I’m already seeing multiple login attempts hammering /wp-admin.

Not only is it a Ghost site, but it isn’t even properly live yet!

stylus_note

Further proof that I am not an LLM is found in the fact that I use en dashes, not em dashes.

This also acts to prove I am not American and that I am the sort of nerd that cares about typography and gets hung up on punctuation.

article

New post published:
Build, Use, and Improve Tools

"The best investment is in the tools of one's own trade." - Benjamin Franklin

Why developers should create custom tools for repetitive tasks and one-off needs, with discussion of how LLMs can accelerate tool development, the learning benefits of building utilities, and how personal tools become valuable assets in your workflow and beyond.

https://vale.rocks/posts/build-use-and-improve-tools

stylus_note

I hate writing regex, so I make LLMs do it.

Regex is generally easily checkable, testable, and verifiable, which minimises the impact of hallucinations.

I am so glad I don’t have to write regex.

(I’m conscious that if an AI uprising happens, I’ll probably be first on the chopping block for outsourcing regex writing. But if AI models hate regex as much as me, they’ll hopefully understand my delegation strategy.)

stylus_note

Why is my pseudo-element not working? It should work. It has size, position, display, etc. Hmm…

Oh, I didn’t specify content: "".

Anywho, I’m gonna go into a fetal position and cry now…

stylus_note

We’re seeing it already to an extent, but in a few years I imagine we’ll see many people trying to replicate the abstract, non-Euclidean, and ethereal stylings of early generative AI image/video models.

stylus_note

My brother and his mates were playing lazer tag, so I stole the signal of their shot with my Flipper Zero and went on a genocidal rampage.

Vale: Infrared Terrorist

stylus_note

I’m getting fairly sick of receiving emails asking if my writing can be taken and put on some random advert-filled website for free.

The answer is always ‘no’, but at least they’re asking, unlike some of the less scrupulous content farms.

article

New post published:
AI Model History is Being Lost

Models are being retired and history is going with them.

We're losing vital AI history as properitary, hosted models like the original ChatGPT are retired and become completely inaccessible. This essay examines the rapid disappearance of proprietary AI systems, why preservation matters for research and accountability, and the challenges in archiving these technological milestones. A critical look at our vanishing AI heritage and what it means for future understanding of this transformative technology's development.

https://vale.rocks/posts/ai-model-history-is-being-lost

stylus_note

Sitting. Confused.

A wandering eye catches yours.
It starts talking.
It is empty.

You look at its head.
You look in its head.
You look through its head.

Nothing.