Change the representation and retain useful alternatives

When changing a flat vector cannot express the needed structure, an inherited description can specify a graph or a generator of networks. The NEAT construction, book §3.3, connects historical correspondence of genes, protection of new structures, time for their weights to adjust and selection of useful further development. Stanley and Miikkulainen’s primary account supplies the actual mutation, alignment and species operations. Aligning genes permits a defined crossover; it does not guarantee that the parents’ useful behaviors survive in the offspring. The resulting network still has to act in the receiving trial.

An indirect encoding inserts another performed operation: inherited material generates a network or developing system, which then produces the behavior being judged. Chapter 4 develops spatial generators, developmental processes and input-dependent constructions. Choose the generator together with the changes it permits. A small inherited edit may alter many connections; a regular generator can make a coordinated change easy while preventing a useful local exception. Return to the generated behavior and its attainable variations when deciding whether to retain, extend or replace the encoding. Compactness alone establishes neither interpretability nor useful future change.

If one best-so-far controller destroys access to materially different continuations, retain an executable collection. In MAP-Elites, evaluate a candidate’s task quality and behavior descriptor, place it in the corresponding region of a defined archive, retain the better candidate for an occupied region, and generate further candidates from retained material. The descriptor decides which differences survive this local competition. Keep each stored controller and the conditions needed to execute it; a plotted dot is insufficient for renewed search or use. Chapter 5 explains related choices, including novelty, local competition, ensembles and reuse of acquired material. C.40:4.12 connects those differences to a consequential later use rather than treating diversity as an automatic benefit.

Uncertain measurements can change which candidate deserves a place, and changing the descriptor changes the archive’s distinction. Re-evaluate the relevant stored material when that difference matters. If the receiving question asks for one adequate controller, retaining a large repertoire may add needless work. If it asks for alternatives across energy, speed or another objective, bounded multiobjective retention is a different construction: NSGA-II selects among nondominated fronts and can discard members when capacity is exhausted. Neither an archive nor a nondominated set proves that every retained controller is suitable for deployment.