NOT.8 - Construct Temporal or Embodied Notation with a Reading Procedure
Type: Method Status: Usable, evolving Normativity: Normative
NOT.8:1 - Problem frame
Use this when a notation carries important distinctions through timing, sound, gesture or bodily position, and recognizing its individual signs does not yet let a reader follow or perform the intended sequence. The reader may lose the cycle, confuse a gesture’s reference frame, or recognize a command without knowing how to enact it.
Start with the distinction the work needs: an onset within a beat, two simultaneous events, a body-relative direction or another stated relation. Choose how the carrier expresses it, provide its reference and segmentation, then construct the procedure by which a reader recovers and uses it.
The result is a temporal or embodied expression with a usable interpretation and reading procedure. It states what a prepared reader can obtain, what remains for performance or control, and how a consequential change affects the reading.
This is notational engineering. Rhythm, movement, laboratory signals and interaction traces supply different subjects; their subject methods determine which timing or motion relations matter. The notation designer needs that subject meaning and the relevant capabilities of the intended reader. NOT.1–.3 supply the general design, formation and interpretation methods.
Reuse a familiar adequate convention when it already supports the operation. An ordinary static expression may suffice when no temporal or embodied distinction matters. Knowing the notation is not by itself a claim that a person can perform a movement or a machine can realize it; obtain the missing performance or control method when the work requires enactment.
NOT.8:2 - Problem
How can a reader recover and manipulate relations that unfold in time or action, including those no longer immediately present when the next sign arrives?
A sequence of recognized sounds can lack a known starting point or grouping. A pause can mean a specified rest, an unobserved interval or a wait for an event. A gesture to the right can refer to the performer’s body, a room or a drawing. These interpretations permit different continuations.
The carrier’s behavior also matters. Playing a recording faster changes its audible duration, but need not change the duration represented by a coded timestamp. A score can specify a desired action while leaving its bodily or algorithmic realization to the performer. The reading procedure must make the relevant convention available.
NOT.8:3 - Forces
| Force | What must be reconciled |
|---|---|
| Transient expression and continued use | A reader may need an earlier sign after it has ceased to be perceptible. |
| Relative and absolute reference | A beat, body direction and clock time support different comparisons. |
| Recognizable sign and interpretable relation | A clear tone or gesture can still have uncertain scope, participant or timing. |
| Compact direction and adequate preparation | A short score can rely on skills or an interpreter that must actually be available. |
| Replay and live enactment | Pausing or slowing can aid analysis while changing the physical process or coordination. |
NOT.8:4 - Solution
Select the temporal or embodied distinction → establish references → segment and encode → construct the reading or enactment route → vary a consequential condition → retain a usable expression.
NOT.8:4.1 - Select what is expressed and what the reader should do
Identify the subject relation and the needed operation. The work may be to recognize an order, reproduce a rhythm, compare two movements, locate a missing event or construct instructions for another performer. Choose the distinctions that operation consumes.
Say whether the expression describes an observed occurrence, proposes a future performance or presents a construction for analysis. The same cue sequence can serve these different uses, but a plan does not establish that its events happened.
Separate the sign’s physical properties from the represented properties. A sustained tone might represent duration by its length, or merely identify an event kind. A hand position might be an action being performed, a sign for another movement, or a reference against which a different action is timed. Use the convention that supports the selected work.
State the reader’s available perception and operations. Distinguishing two timbres, maintaining a pulse, recognizing a body part and following a formal event code are different prerequisites. A computational reader needs a suitable input representation and interpretation, not an assumed human sensory skill.
NOT.8:4.2 - Establish the references that locate an occurrence
Give the origin, unit, frame or recurring reference needed to interpret the signs. For cyclic time, identify the cycle and position within it when occurrences across cycles must be distinguished. For movement, identify the participant, body part, spatial frame and starting condition that affect the interpretation.
Choose whether timing is absolute, relative to another event or relative to a maintained pulse. If a tempo change should retain relative positions, preserve that relation when changing elapsed durations. If a deadline is in seconds, a mere proportional rescaling may change the required result.
Give different participants a way to align their references when joint action or comparison needs it. A shared visible pulse, a named event or a common clock can supply alignment under its own conditions. Separately timestamped records do not establish event order unless their clock relation supports that inference.
Keep the reference identifiable during use. A repeated syllable can denote the same position in successive beats while being a different occurrence each time. A rightward direction can change in room coordinates when its body frame turns.
NOT.8:4.3 - Segment and encode the needed relations
Choose recognizable units and a rule for joining them: separate events, intervals, phases, gestures or other parts appropriate to the subject. Mark a beginning, boundary or return to a cycle where losing it would change the reading.
Assign signs and their temporal or spatial arrangement to the selected distinctions. Make order, overlap and duration recoverable when the work needs them. Writing two signs successively does not express simultaneity unless a grouping or interpretation rule supplies it.
Provide a way to distinguish a specified absence from a missing observation. A rest within a known beat and a recording gap can both be silent, but only the former supplies the intended absence. Use a marker, an accompanying record or another recoverable convention where the difference affects the next operation.
Inspect discriminability under the intended conditions: speed, overlap, background sound, viewing direction or available sensors. A symbol family that is distinct on a page can become confusable when sounded or gestured. Change the encoding or access arrangement if the needed contrast disappears.
Choose detail for the receiving use. A movement score can constrain endpoints while leaving the route open; a different use can require the route, timing or body-part coordination. Keep an omitted choice with the performer or construction method that is to supply it, rather than silently giving the notation credit for it.
NOT.8:4.4 - Construct the reader’s route through the expression
State how the reader establishes the reference, identifies the current part, combines it with retained information and obtains the next result. Make the necessary repetition, count, comparison, transformation or enactment available. A legend naming sounds or gestures may need this additional procedure.
For a transient carrier, choose how earlier parts remain usable: replay, a persistent companion record, a repeated reference, trained retention or another available means. Use only what the receiving conditions permit. NOT.6 connects a score, sound and event table when several forms remain necessary.
If the task is performance, connect the decoded instruction to the performer’s available method. A person may already know how to realize a gesture or syllable. A machine may need a parser, state representation, control algorithm and physical realization. CMP.12 constructs an effective interpreter; B.5.MPC connects the abstract construction to preparation, execution and interpreted observation. Notation alone does not supply those methods.
A demonstration can be part of the supplied interpretation. Identify what it teaches and keep it available if the text relies on it. If another prepared reader can use the expression without that demonstration, the reading condition is different; assess the contribution at the condition actually offered.
NOT.8:4.5 - Challenge the relation with a meaningful change
Carry out or inspect a small use and a contrast that can change its result. Shift a cue while retaining its identity, change a body’s orientation, remove a timing reference or ask for simultaneity rather than order. Choose a contrast grounded in the intended operation.
Distinguish reading from successful physical performance. A correctly decoded sequence can still be infeasible for a particular body or controller. Locate that missing realization contribution rather than changing the meaning until the observed performance appears correct.
When using replay, decide which property it can preserve. Slowing a recording can aid segmentation. It cannot by itself demonstrate that a performer meets the original speed, that two live processes stay synchronized or that a paused physical system stops evolving.
A worked interpretation supports its stated use. Claims about human fluency, learning or transfer require their own basis; C.2.8 and the applicable capability-development method characterize the relevant recovery or performance. Use the current sufficient result, and seek an additional trial only when its outcome can change the next choice.
NOT.8:4.6 - Retain the expression with its operative convention
Keep the reference, segmentation, interpretation and needed reading procedure available with the expression. A short local convention may suffice; reusable performance material may also need a demonstration, an interpreter or an accessible alternative carrier.
State an unresolved performer choice or lost distinction where the next use needs it. A score specifying endpoints can be useful before a motion path is chosen. A recording with an unobserved interval can support the observed segments without settling the missing order.
Stop when the selected operation is supported or the missing contribution is located. Use NOT.7 if the interpretation is determinate but difficult to follow. Reopen the affected convention when the reference frame, timing, medium, required observation or reader capability changes.
NOT.8:5 - Archetypal Grounding
NOT.8:5.1 - Recover a cue’s place in a beat
Choose a beat divided into four equal positions. In the Takadimi convention these positions are voiced as ta, ka, di and mi. For this example, a dot in the written grid means no new onset at that position; it does not specify how long an earlier sound continues.
| Position within the beat | 0 | 1/4 | 1/2 | 3/4 |
|---|---|---|---|---|
| Position syllable | ta | ka | di | mi |
| First onset pattern | ta | . | di | . |
| Shifted onset pattern | . | ka | . | mi |
Establish a steady beat, divide it into four and keep the beat’s start identifiable. The first pattern has onsets at 0 and 1/2. A shift of one quarter-beat, within this one-beat example, yields onsets at 1/4 and 3/4. The new syllables identify the new positions. Repeating the same two spoken syllables without their reference would not express this change of placement.
At a beat duration of one second, the first onsets occur at 0 and 0.5 seconds; the shifted ones at 0.25 and 0.75 seconds. At a beat duration of half a second, the corresponding times halve while the relative positions remain. A requirement for an onset at an absolute 0.5 seconds is therefore a different requirement.
If the sound between two known positions is unrecorded, do not replace that gap by a written dot claiming no onset. Preserve the missing-observation status. If the next operation asks how long notes are held, add the needed duration convention: the onset grid alone does not answer it.
This is a notation construction, not a claim that reading the table teaches fluent rhythmic performance. Maintaining the beat and coordinating speech are available skills or contributions to be learned.
NOT.8:5.2 - Read a movement relative to a changing body frame
A tabletop movement score uses two signs. R means move one grid unit to the performer’s right without turning; F(2) means move two units forward without turning. The signs describe successive completed displacements. The starting position is (0, 0), with east as positive x and north as positive y.
A performer initially facing north reads R; F(2) as an eastward unit displacement followed by two northward units. The endpoint is (1, 2). The reading procedure first recovers the starting orientation, translates each body-relative direction into the grid frame, updates the position and continues from there.
Now the performer starts facing east. The same score yields one unit south and two units east, ending at (2, -1). Treating R as page-right would give a different route. If the intended task is to preserve the original grid-space path regardless of orientation, choose a grid-relative notation or construct the appropriate body-relative instructions; keeping the marks unchanged does not meet that new task.
The score leaves the speed and path within each displacement unspecified. It can guide a prepared person moving a token. Making a physical robot perform it additionally requires an applicable motion method and an account of its realization. Reading the endpoint establishes neither that method nor a performed movement.
NOT.8:6 - Bias-Annotation
Expert fluency can conceal the reading procedure. A musician or dancer may supply pulse, segmentation and bodily realization without noticing those contributions. Recover them before expecting a newcomer or computational agent to use the same expression.
A familiar carrier can also invite the wrong relation. Spoken order can be mistaken for event order, silence for a rest and a facing gesture for a room-fixed direction. Use a consequential contrast to determine which reference the notation supplies.
NOT.8:7 - Conformance Checklist
When the expression needs checking, ask the questions that can change its use.
- Is the represented relation and intended reading or performance operation recoverable?
- Are the needed origin, unit, cycle, participant and frame available?
- Can the reader segment occurrences and distinguish the relevant order, overlap or duration?
- Is a specified absence distinguishable from missing information where it matters?
- Does the reading procedure identify the retained state or replay that it needs?
- Are perception, interpretation and physical performance contributions supplied at their stated scopes?
- Does a meaningful change preserve the intended relation or reveal the required repair?
NOT.8:8 - Common Anti-Patterns and How to Avoid Them
| Failure | Repair |
|---|---|
| Providing a list of sounds or gestures without their temporal or spatial reference | Establish the beat, origin, participant or frame needed to interpret occurrences. |
| Equating recording silence with a specified rest | Preserve the observation gap and request the missing contribution only if the use needs it. |
| Reading body-right as page-right | Recover the frame and transform directions, as in :5.2. |
| Counting correct sign recognition as successful enactment | Connect the decoded result to a capability or control method that can realize it. |
| Claiming original-speed competence from slowed replay | Limit replay to the property it preserves; inspect performance under the required timing when that claim matters. |
| Giving every score maximal movement detail | Express the constraints the receiving use consumes and retain the performer choices compatible with those constraints. |
NOT.8:9 - Consequences
Temporal and embodied expression can become a manipulable part of reasoning: readers can locate occurrences, vary a relation, compare performances or hand an interpretable instruction to another agent. A score can retain useful constraints while allowing more than one realization.
The method exposes preparation and access costs that a fluent practitioner might leave tacit. Additional references can burden performance; a persistent companion representation can help analysis while requiring coordination. Some expressions remain useful only with a trained performer or an available interpreter.
NOT.8:10 - Architectural Rationale
Temporal or embodied expression adds reference and availability problems to ordinary formation and interpretation. What a sign means can depend on phase, orientation or the reader’s retained state. These conditions belong in the operative convention rather than an assumed resemblance between mark and action.
Segmentation serves the receiving operation. An action can be described by its intended result, selected intermediate constraints or a detailed movement account. Those descriptions require different contributions from a performer. Keeping that distinction permits transfer between people and machines while exposing what must be reconstructed.
Reading and enactment are connected methods. Their separation makes the connection constructive: decode what the score requires, determine what the performer must supply, obtain that method and interpret the resulting action. This retains the relation between mathematical structure, algorithms and physical realization.
NOT.8:11 - SoTA-Echoing
| Source and contribution | Adoption and limit |
|---|---|
| Nelson, Solkattu Manual, Introduction, pp. 2–3 | The account connects spoken patterns with recurring hand references and distinguishes spoken from played realization. It informs :4.2 and :4.4. The book explicitly resists a simple one-syllable/one-stroke identification; the method keeps the actual convention and training contribution. |
| Takadimi Basics and Teaching with Takadimi | The position-based syllable convention supplies :5.1; coordinated pulse and voice illustrate a reading procedure. This is a particular convention, distinct from Nelson’s treatment, not a general theory or an empirical guarantee of instruction quality. |
| Salaris, Abe and Laumond, A Worked-Out Experience in Programming Humanoid Robots via the Kinetography Laban, 2016, §1 and pp. 346–348 | The worked connection distinguishes a score’s action constraints from detailed human or robot motion and exposes the control-space contribution. Adapt that distinction in :4.3–.5. The earlier robotic demonstration supplies a constructive anchor, not a claim that any score automatically yields feasible robot motion. |
| Guerreiro, Amaral and Goulão, Unleashing the Power of Sound, 2023, §§III and VI.D–E | Adopt the question of audible discrimination and context into :4.3. The UML sound study measures bounded preferences and perceived relevance, with limitations in baseline choice, sample and setting; it does not establish general comprehension, multi-representation integration or universal sound meanings. |
Choosing a form for the same operation. In :5.1 the reader must locate and shift two onsets within a beat. Compare a static position grid with a sounded score, for a reader who knows the syllables and can count the four positions. The grid already answers the question and remains available for inspection. Keep it when that is the whole task; adding voiced practice would cost effort without improving this answer. A familiar convention also needs no extra account when its references and reading operations are already available to the reader.
For following the onsets during a performance, both a retained grid and a sounded score still need a way to keep place in the beat. Here we adapt Nelson’s recurring reference and Takadimi’s positional reading into :4.2 and :4.4: maintain the reference, locate each occurrence and retain or replay the parts needed for the next operation. This repairs the case in which a sign legend identifies syllables but leaves their positions unavailable. It does not require a new symbol vocabulary. A prepared reader may maintain the reference while reading the grid; a sounded or embodied form is preferable only when its coordination benefit warrants the added perception or practice. Those costs are the accepted trade-off, not a demonstrated general learning advantage.
The beat calculation in :5.1 shows the information gained from the reference; it does not compare human performance speeds. The source table supplies the limits of transferring this reasoning to movement and audible interfaces: a recovered instruction still needs its performer method, and preferred sounds need not improve interpretation. Reopen this choice if a simpler available convention supports the same operation and timing with less burden, or if the chosen reference or reading procedure fails under the receiving conditions.
The synthesis uses these different practices to expose recurring design operations; it does not merge their symbol systems. A position syllable, a stroke-associated syllable and a motion sign can carry different relations. Reopen the construction when a relevant contrast is not perceptible, a reader lacks an assumed operation, a new realization cannot supply the omitted work or a receiving use needs a previously unexpressed relation.
NOT.8:12 - Relations
| Pattern | Contribution to the working method |
|---|---|
| NOT.1–.3 | Supply distinction selection, expression formation and operative interpretation. |
| A.6.3.RT.OE | Constructs an expression around the operation it should make possible. |
| NOT.4–.5 | Preserve selected temporal or embodied uses during transformation and expose translation losses. |
| NOT.6 | Coordinates transient expression with a score, event record or other complementary form. |
| NOT.7 | Repairs difficult reading or manipulation after the interpretation is established. |
| CMP.12 | Constructs the effective interpreter or translation when a computational reader is needed. |
| B.5.MPC | Connects abstract relations and computation to preparation, physical execution and interpreted observation. |
| C.2.8 | Characterizes structure recovered under the intended reader’s preparation, access and available operations. |