Reinforcement Learning (Plugins)

Perfect


I test this and make a feedback rapidly

this
http://cs.stanford.edu/people/karpathy/convnetjs/demo/rldemo.html
will be very helpful i think

Perfect


I test this and make a feedback rapidly

this
http://cs.stanford.edu/people/karpathy/convnetjs/demo/rldemo.html
will be very helpful i think

It will be possible to share your file CAPX?
I want to learn, please.

I can't get this to work. Have tried the simplest training I could imagine: One input (random either "a" or "b") and two outputs (either "a" or "b"). Match between input and output is rewarded with 10, mismatch is punished with -10. After 20 minutes of "training" the output is still completely random.. Am I doing it wrong? @fundation2000

After 20 minutes of "training" the output is still completely random.. Am I doing it wrong?

Hi Jan. At first glance what you're doing looks correct to me. In my experience, it usually takes around 200.000 ticks (e.g. 3 hours) for the agent to begin behaving intelligently, e.g. to see it converge. This is a downside of Construct 2 - it only allows actions each tick, so you can't accelerate training beyond that.

Also, try setting Action:Learning to turn off the learning process after the training period - this way the agent won't undertake any more random actions and you get a clearer picture of the outputs which are correlated to your inputs.

You are right! After a long time it gets a lot better. Thank you!
Have you tried it on images?

I haven't, but I think it's not outside the realm of the possible.

However, if you want to look into this beyond game-AI-behaviour, I'd recommend you switch to either the JS version (or another version) of Deep-Q-Learning (here) which you can have running at thousands of ticks per second (instead of 60fps) or focus on some machine learning library, for example by using Tensor Flow.

Who has a simple example please share!

Code: Select all

 instanceProto.saveToJSON = function ()
    {
        // return a Javascript object containing information about your object's state
        // note you MUST use double-quote syntax (e.g. "property": value) to prevent
        // Closure Compiler renaming and breaking the save format
        return { "brain_valuenet": this.brain.value_net,
            ................................................................

                //"layer_defs": this.layer_defs,
                "network_size": this.network_size >>>,<<<
        };
    };

The extra comma. Incorrect json and does not work LoadJSON

Thank you for pointing this out DeXVinogradov, I will fix it in the coming days.

C2 SAVE/LOAD not supported.
No respons on support request
-1