Kaizen-R.com new home

RLCS: Caring for better performance

RLCS

code

Optimization

There was still room for improvement. Probably still is, of course, just… Not with a total redo, I guess.

RLCS: Making things faster where it matters

RLCS

code

Optimization

This entry was not “planned”, as I am still working on this last bit, and also I shouldn’t touch things as I have a presentation coming next week on this, but…

RLCS: small code rewrites

ML

RLCS

code

Optimization

As announced, I’m doing some code rewriting, just because…

RLCS: Better code?

ML

RLCS

code

Optimization

Most of the code thus far was about getting it to work, and for it to not be too slow at runtime (with several approaches considered).

Sunday Thoughts: About Strategy, Information, Decisions, Simulations, Reinforcement Learning & al.

Information

ML

Decisions

Optimization

Yesterday I did nothing. Like… Nothing. I considered it an active choice, and as such I wasn’t sad at the end of the day for not having “produced” anything… And today I was…

RLCS: Small addition

ML

RLCS

I was in attending a local R conference the other day, and took the opportunity to discuss a bit with some of the (very few) that have a minimal interest (and an…

RLCS for Data Mining: Visuals

ML

RLCS

visualization

I’ve shown quite a few “Classifiers” and detailed how data mining can be cool with an LCS.

RLCS & Explainable AI

ML

RLCS

visualization

I have been open about some of my worries with GenAI (and in fact Deep Learning with Neural Networks).

RLCS for RL: It works again (using books helps)

ML

RLCS

Recently, I had “broken” my Reinforcement Learning implementation, in the sense that it would learn at first, and then it would get worse with more experience, instead of…

Migrating Contents (slowly)

news

I’ve had my own kaizen-r.com blog for some time, and I relaunched on github.io in November last year.

RLCS: Improving… And getting worse (at the same time!)

ML

RLCS

Well, it’s been a couple of weeks (I was a bit offline last couple of weekends, I guess). So I’m back at it and, first, I needed to clean things up. It just was messy code.

RLCS: Reinforcement Learning: World Explorer v1

ML

RLCS

This is quite literally my first Reinforcement Learning exercise ever. Coded from scratch. With no Neural Network whatsoever, but instead, using my own implementation of the…

RLCS: A World to Play RL

ML

RLCS

Today I just started something simple: An Object to represent a simulated World in which an Agent can move.

RLCS: Reinforcement Learning?

ML

RLCS

At least the XCS version of LCS algorithm is a “well-known” (in the rather small sub-world of LCS enthusiasts, that is) approach to do Reinforcement Learning.

RLCS: training in parallel?

ML

RLCS

I’ve already tried to parallelize a bit the training of a supervised-learning LCS. It kinda’ works… But the more I think about it, the more I’m convinced it’s not as easy as…

RLCS: for Data Mining

ML

RLCS

The exact same code to do supervised learning can be used for data mining. In fact, I’ve already shown that, with the “not-bit-4” example.

RLCS Day 4.5 - Fully Functional v0 and New Tests

ML

RLCS

Version “0” is done and working. And I will say this, it is already showing some of its power. Let me show you.

RLCS Day 2 - Full Rule Discovery

ML

RLCS

I have yet another day off (that’s the thing with Holiday season), and I really wanted to keep working on this.

RLCS Day 1 - Part II: Basic Covering

ML

RLCS

So I had a bit of time. And I chose to use it to keep going a bit. I moved a couple of things, created a few more supporting functions, modified them somewhat, and added the…

RLCS Day 1: Rules formatting, storage, and matching

ML

RLCS

So I wasn’t kidding. I really like this “Learning Classifier System” (aka LCS) idea, and I really want to develop the R package for it, which I will call “RLCS” (clever, hu?).

A new project

ML

news

RLCS

Ever since I read about the concept in M. Mitchell’s book “Complexity The emerging science at the edge of order and chaos” some time last year (I think around this time of…

Understanding Linear Regression

ML

math

This is probably one of the last entries from my preparation to introduce “Background of ML for Cybersecurity”. This time, it’s really about what should probably have been…

Classifying URLs

ML

code

I’m still working my way through a “practical demos” session on ML background for Cybersecurity.

Entropy - Identifying compressed files

math

code

About Shannon’s Information Entropy, applied to potentially detecting ciphered or compressed text compared to plain text.

Welcome To My Blog

news

This is the first post in this future Blog. Currently testing all kinds of things, will updated hopefully shortly!

ML Concepts: Word Embeddings

ML

NLP

I discussed an unsupervised clustering algorithm, DBScan. We used multi-dimensional points (coordinates) in space. But what if our data is text? That’s common in “general”…

ML Concepts: Unsupervised Learning – Clustering – DBScan

ML

visualization

So as I keep working on an upcoming presentation I shall give in a few weeks, I thought I’d prepare something a bit more “live” than just a PPT with Memes (although who…

Random Exercises: Interpolation with Lagrange Polynomials

math

As I want to make sure I keep posting here, I keep looking for things to write about in my own personal “library” (book shelves).

While on the Train: Cellular Automata

visualization

I decidedly LOVE riding on a train: For whatever reason, it’s one particular moment where I somehow focus a bit more than usual. It’s usually just a few hours, reasonably…