HYPOTHESIS AND THEORY published: 20 April 2015 doi: 10.3389/fpsyg.2015.00313 Edited by: Adam M. Croom, University of Pennsylvania, USA Reviewed by: David Borgo, University of California, San Diego, USA Donald Glowinski, University of Geneva, Switzerland *Correspondence: Ashley E. Walton, Department of Psychology, Center for Cognition, Action and Perception, University of Cincinnati, 4130 Edwards 1, ML0376, Cincinnati, OH 45221, USA waltonal@mail.uc.edu Specialty section: This article was submitted to Theoretical and Philosophical Psychology, a section of the journal Frontiers in Psychology Received: 15 December 2014 Accepted: 05 March 2015 Published: 20 April 2015 Citation: Walton AE, Richardson MJ, Langland-Hassan P and Chemero A (2015) Improvisation and the self-organization of multiple musical bodies. Front. Psychol. 6:313. doi: 10.3389/fpsyg.2015.00313 Improvisation and the self-organization of multiple musical bodies Ashley E. Walton1*, Michael J. Richardson1, Peter Langland-Hassan2 and Anthony Chemero1,2 1 Department of Psychology, Center for Cognition, Action and Perception, University of Cincinnati, Cincinnati, OH, USA, 2 Department of Philosophy, University of Cincinnati, Cincinnati, OH, USA Understanding everyday behavior relies heavily upon understanding our ability to improvise, how we are able to continuously anticipate and adapt in order to coordinate with our environment and others. Here we consider the ability of musicians to improvise, where they must spontaneously coordinate their actions with co-performers in order to produce novel musical expressions. Investigations of this behavior have traditionally focused on describing the organization of cognitive structures. The focus, here, however, is on the ability of the time-evolving patterns of inter-musician movement coordination as revealed by the mathematical tools of complex dynamical systems to provide a new understanding of what potentiates the novelty of spontaneous musical action. We demonstrate this approach through the application of cross wavelet spectral analysis, which isolates the strength and patterning of the behavioral coordination that occurs between improvising musicians across a range of nested time-scales. Revealing the sophistication of the previously unexplored dynamics of movement coordination between improvising musicians is an important step toward understanding how creative musical expressions emerge from the spontaneous coordination of multiple musical bodies. Keywords: music improvisation, self-organization, movement coordination, complex dynamical systems, multiscale analysis "Human beings learn and do things that have never been done before." (Smith, 2010, p. 344) On a first reading, Linda Smith's statement does not seem particularly earth shattering. Yet the novelty and creativity of human behavior is precisely what makes it exciting and difficult to understand, as well as difficult to replicate in terms of artificial intelligence. These abilities are not limited to genius inventors or idiot savants; they are used in any instance in which a task is carried out without a detailed plan of execution, where the steps and goals are not predetermined, but discovered through the course of action (Smith, 2010). Within the research literature this ability is discussed using terms like creativity studies (Duncker, 1945), abductive reasoning (Kloos and Van Orden, 2012), emergence and insight problems (Ohlsson, 2011). And while the focus of these studies may range from the processes engaged by Van Gogh when creating a master painting (Ghiselin, 1952), to observing how participants fasten a candle to a door with limited and misleading materials (Duncker, 1945), even everyday, planned tasks require constant moment-to-moment improvisation. You can never step into the same river twice, never play the exact same game of soccer, never navigate your car through Frontiers in Psychology | www.frontiersin.org 1 April 2015 | Volume 6 | Article 313 Walton et al. Multiple musical bodies the exact same highway traffic, or cook your favorite meal the exact same way – "life is a continual improvisation" (Agre and Chapman, 1987, p. 268). Given the challenges in understanding the processes behind everyday behaviors and tasks, explicating the skills behind musical improvisation is vastly more complex. Explanations of this ability thus far have focused on exactly how musicians are able to engage in performance that demands immediate, yet coherent musical expression from an infinite number of combinatorial possibilities. Pressing (1998, 2000) and Berkowitz (2010) both developed theories for how musicians can engage in such spontaneous musical action. Pressing focuses on the skills and tools musicians use to overcome the limitations of their informationprocessing capacities. Berkowitz proposes a cognitively economical "knowledge base" which optimizes speed and efficiency by organizing musical materials into higher-level categories according to their function (Berkowitz, 2010, p. 54). This knowledge base is refined through practicing variants of different musical expressions, as well as developing an understanding of how these units can be combined appropriately – a skill he calls recombination. This skill is achieved through statistical learning, where transitional probabilities that describe the likelihood of one musical event following another form patterns, which are captured in the hierarchical structure of the musician's knowledge base. This is meant to ameliorate the overwhelming task of choosing from the infinite possibilities such that when an improviser anticipates the need for a certain musical phrase, the knowledge base is drawn upon and "the ears and/or body" can "choose a variant suitable to the musical situation at hand" (Berkowitz, 2010, p. 54). While fully appreciating the complexity of musical improvisation can seem to render its explanation impossible, this paper will attempt to outline a new approach to clarifying how this behavior is achieved, and how, as Berkowitz (2010) says, the ears and the body choose. The first section will discuss the role of body movement in music performance as well as the perception of musical action. The second section will move forward from the role of body movement in communication between a musician and a passive listener, to consider the complexities of movement coordination in the communication between two active co-performers. The third and fourth sections will introduce newmethodological and theoretical approaches that we argue can help address the complexity of inter-musician movement coordination by uncovering the dynamics of the non-stationary, aperiodic and spontaneous behavioral coordination that characterizes musical improvisation. The Lives of Bodies Not only is the act of musical improvisation demanding and complex, but at the peak of performance musicians are often unaware of their actions and the details of how their skills are being executed. Berkowitz (2010, p.125) calls this the "creatorwitness phenomenon"; Jeff Pressing explains how "... the hands appear to have a life of their own, ... in a sense, the performer is played by the music" (Pressing, 2000, p. 139). Not only is this experience common to improvising musicians, but this sense of "flow" is considered to be particularly important to higher quality performance as well as increased psychological well-being (Csikszentmihalyi, 1990; Csikszentmihalyi and Csikszentmihalyi, 1992; Croom, 2012). Berkowitz claims that "letting go" allows for the automated components and processes that make up a musician's expert knowledge base to run the show. But despite its importance, exactly how this knowledge base and these processes are at play during these creator-witness experiences is left an enchanting mystery, where the "musical flow magically [emphasis added]manifests, without a need to know or remember where one has been or where one is going" (Berkowitz, 2010, p. 130). In these moments of limited conscious awareness and heightened creativity, the same statistical regularities and transitional probabilities Berkowitz describes as being encapsulated by this conceptual knowledge base, map directly onto sensory-motor experiences (Smith, 2010). Focusing on an explanation of how a stable knowledge base supports improvisational musical expression forgets the lives of the hands (Sudnow, 1978), the choices of the ears (Berkowitz, 2010)– the body's own actions (Berliner, 1994). As we will explain, this widespread attribution of agency to the body and its limbs goes beyond simple metaphor to provide new possibilities for discovering stable patterns in the behavior of improvised performance, aside from a conceptual knowledge base. The importance of body movement in understanding musical performance has become well accepted, championed by Vijay Iyer in his detailed accounts of how musical bodies tell stories (Iyer, 2002, 2004). The dynamics of movement and force in musical performance have been widely examined experimentally, (see Keller, 2012; Palmer, 2013 for review), with kinesthetic patterns found to be the primary determinant of everything from musical genres, to structures of instruments, as well asmusician's personal identities (Baily, 1985; Dalla Bella and Palmer, 2011). This bodily motion is essential to understanding not only the production but also the perception of music. Listeners directly experience the "articulators" of performers, hearing the changes in rate and force of their body movements that produce musical sounds (Shove and Repp, 1995). Thompson et al. (2005) reviewed evidence for how visual information about performer's movements influences listeners' perception of music, examining the bodily-mediation of facial expressions and limb gestures used by musicians to highlight and articulate phrases within the performance. These kinesthetic "affect displays" of performers like BB King opening his mouth and shaking his head to match the vibrato of a note, serve to constrain the perceptual experience of listeners (Thompson et al., 2005, p. 207). These musical movements are not considered peripheral, but as providing direct access to the perceptions, moods and feelings of listeners (Maes et al., 2014). Thus the kinesthetic dimension is crucial to investigating the complexities of music improvisation. And with the discussion of bodily mediation as well as bodily actions, we see the importance of body movement both in the production of sonic events, and in the communicative processes that make up a musical performance. Understanding music improvisation is not only about the brain and the body, but also the environment: an environment that can include an audience as well as other performers. Given Frontiers in Psychology | www.frontiersin.org 2 April 2015 | Volume 6 | Article 313 Walton et al. Multiple musical bodies the already long list of demands on musicians when improvising, it seems that the additional task of communication makes the ability seem even more "magical," and explicating the processes behind "letting go" more elusive. Musicians not only have to spontaneously produce innovative and cohesive musical expressions from an overwhelming number of combinatorial possibilities, but simultaneously interpret and coordinate with those produced by other performers. Nardone (1997), in interviews with musicians about how they improvise, uncovers the tactic of "ensuring spontaneity while yielding to it" (Berkowitz, 2010, p. 125). Examination of these communicative, bodily processes can provide a way of understanding exactly what is happening when musicians "let go" and submit to musical spontaneity. Spontaneous Coordination of Multiple Musical Bodies There is still much left to understand about the complexity of the coordination and communication that occurs between groups of improvising musicians, especially because many of the experimental investigations thus far have focused on individual improvisers (e.g., Keller et al., 2011; Norgaard, 2011, 2014). Yet the paradigmatic example of improvisation is a jazz quartet, where multiple musical bodies must spontaneously coordinate while simultaneously engaging in both musical perception and action. They engage in a continuous negotiation– anticipating and coordinating their playing behavior without the guide of musical notation. Musical performance emerges within a context of social collaboration, resulting from the ongoing interactions among multiple individuals, where members are collaborating to construct and negotiate the flow of the performance from moment-to-moment (Sawyer, 2003). Understanding the dynamics of the performance of musical groups will not be achieved by linear decomposition, isolating out an independent flow of each individual musician's conceptual knowledge base or musical movements. Interpersonal coordination is not easily isolated into components defined by content or a particular frame of time. Musician's movements may at times involve explicit communicative signals such as a touch to the head that signals "back to the top," or eye contact and nodding of the head before or after solos. But these are just a small part of a continuous flow of information about a co-performer that supports adaptive coordination and communication across the multiple time scales of an improvised musical performance. When engaged in the continuous action and perception required of musical coordination, it is not possible to identify the different component parts of a co-improvisers' actions and their exact intended meaning within the flow of performance. The perceptual delays and latencies inherent to group performance present another challenge to investigating the continuous nature of spontaneous musical coordination, whether it is a duet, quartet or orchestra (Davies et al., 2013). And while these delays are measured in milliseconds, in some instances certain musical forms like jazz are dependent on deviations from the beat at very small time scales. And these deviations have not only been found to be preferred by listeners (Hennig et al., 2012), but even to be an index of the health of a musician's physical system (Ruiz et al., 2014). The demands onmusicians are mounting: they must choose from an infinite set of possible musical expressions, continuously adapting and coordinating their musical action and communication with co-performers, despite perceptual delays, in order to produce something meaningful within the context of the performance. Understanding the dynamics of this improvisatory behavioral coordination is not trivial. Continuous adaptation is also demanded of groups of musicians performing a pre-rehearsed piece (Keller, 2008), but the lack of structure in improvisational performance potentiates anticipatory coordination that can result in dramatic transitions toward unexpected trajectories. Much of the experimental work that investigates groups of musicians' movements has examined the dynamics when musicians play a pre-rehearsed musical score (Keller and Appel, 2010; Loehr and Palmer, 2011; Palmer and Loehr, 2013; Ragert et al., 2013). Yet the unstructured nature of improvisation is such that these new trajectories are discovered when musicians act upon information that they detect about their co-performer, as well as adapt their playing in order to re-contextualize and take advantage of musical errors or "noise." Anticipatory movement coordination or musical motor predictions (Novembre and Keller, 2011) are an important part of the initiation of these transitions to novel modes of expression. Even unintended fluctuations in performance are crucial to the development of new musical structures (Borgo, 2005), and there is reason to believe that these fluctuations can occur in the kinesthetic as well as the sonic dimension. As saxophonist Evan Parker puts it, "sometimes the body leads the imagination"(Borgo, 2005, p. 58). Quantifying the collective changes and transformations in the body movement coordination between improvising musicians can help explicate the complexity of spontaneous performance, as well as provide a glimpse of the dynamics that make possible the emergence of previously unimagined forms of order. In the next section we introduce methods for quantifying the evolution of inter-musician movement coordination continuously across the time span of a performance, capturing the behavior at multiple, nested time scales. Measuring Spatiotemporal Patterns of Musical Spontaneity "The major role of improvisation in many oral musical traditions, combined with the important function of groove, make possible alternative notions of musical form . . . in which meaning of music is located in the free play of smaller constituents." (Iyer, 2008, p. 278) In trying to understand the complexity of generating new musical meaning in improvisation, many describe the processes by which musicians learn to spontaneously combine smaller sonic units. Berkowitz (2010) describes how musicians introduce variation to musical patterns at multiple levels, recombining smaller elements to form new musical entities. Yet we suggest that the behavioral coordination that occurs between Frontiers in Psychology | www.frontiersin.org 3 April 2015 | Volume 6 | Article 313 Walton et al. Multiple musical bodies improvising musicians may be best conceptualized as emergent, involving the continuous self-organization of the perception and action processes that support musical play. The tools of complex dynamical systems provide powerful methods for the investigation of both sonic and kinesthetic patterns at multiple time scales, while avoiding an "arbitrary segmentation" of the continuous flow of information for musical perception and action (Demos et al., 2014, p. 2). Complex dynamical systems are those that consist of a large number of interacting components that give rise to collective behavior that can be difficult to anticipate from knowledge of the individual components that make up the system (Richardson et al., 2014). Dynamical models have been employed in understanding how musicians improvise (Pressing, 1999, 2000) and coordinate with rhythmic sequences (Loehr et al., 2011), but David Borgo's 2005 book Sync or Swarm is the most detailed account of exploring the skill of musical improvisation using the statistical tools of complex dynamical systems theory. More recent applications of these methods to examine musical movements and musical structure include: fractal analysis (Beauvois, 2007; Rankin et al., 2009; Demos et al., 2014; Hennig, 2014; Ruiz et al., 2014) recurrence quantification analysis (Serrà et al., 2009, 2011; Demos et al., 2011) and sample or Shannon entropy (Keller et al., 2011; Goldman, 2013; Glowinski et al., 2013). Here we will focus specifically on the potential of cross wavelet spectral analysis for investigating musical movement coordination. Cross wavelet spectral analysis is a non-linear time series method that has been widely used in the fields of geological sciences and physiology. More recently Schmidt et al. (2014) has demonstrated its use in understanding the movement coordination that occurs between co-actors during joke-telling and dancing (Schmidt et al., 2014;Washburn et al., 2014). As noted by Schmidt et al. (2014), the advantage of cross wavelet analysis is its ability to reveal common periodicities in behavioral coordination at nested time scales, detecting local microscale structures (e.g., note or bar) within global macroscale patterns (e.g., chorus or piece). Importantly, it provides this local and global information without assuming the time series is stationary. This means it is able to capture the time-evolving behavior in time series that are noisy, contain a drift or sudden change in the mean, or a "brutal" change in frequency (Issartel et al., 2006, p. 151)– all of which are likely in the complex patterns of coordination that emerge during spontaneous musical performance. More specifically, cross wavelet analysis assesses coordination between two time series through spectral decomposition, and subsequent examination of the strength (coherence) and patterning (relative phase) of the coordination that occurs between participants across multiple time scales (see Grinsted et al., 2004; Issartel et al., 2014, for a more detailed introduction). The strength of coordination and the relative phase angle between two time series is assessed for shorter, half second and secondto-second time-scales, as well as at longer 4, 8, 12, and 16 s time-scales. Figures 1 and 2 demonstrate the use of cross wavelet analysis to investigate the coordination between the lateral movements of the forearms of two piano players. Their movements were recorded using wireless motion-tracking sensors attached to their wrists while they improvised over a musical backing track. The time series of their limb movements were then analyzed using functions available in MathWorks' free wavelet toolbox [Copyright (C) 2002-2004, Aslak Grinsted]. Themovement timeseries were also low-pass filtered prior to analysis using a 10 Hz Butterworth filter. For each of the different time scales an average measure of the correlation of the time series was calculated on a scale from 0 to 1, as well as the average distribution of relative phase angles (DRP) that occurred between the musicians' movement time series. One can observe the strength of coherence over the course of the performance as denoted by color (red for high coherence, dark blue for low to no coherence) for each period (in units of seconds) on the y-axis. The arrows correspond to the relative phase of the coordination. Right arrows equal in-phase coordination (the two systems are visiting the same states in perfect synchrony) and left arrows equal anti-phase coordination (the two system are visiting states that are in perfect opposition). FIGURE 1 | Cross wavelet plots of the lateral movements of the musicians' right forearms, displaying the strength of coherence at each period (red for high coherence = 1, dark blue for low to no coherence = 0), as well as relative phase angle (right arrows equal in-phase coordination, left arrows equal anti-phase coordination). (A) Displays the coordination between two piano players playing the exact same part, in synchrony with the ostinato backing track. (B) Displays coordination while the musicians improvise over the ostinato backing track. Frontiers in Psychology | www.frontiersin.org 4 April 2015 | Volume 6 | Article 313 Walton et al. Multiple musical bodies One particular advantage of this analysis is the ability to determine how movement coordination relates to the shorterand longer-term temporal structure and phrasing of the musical context. This is demonstrated by comparing the cross wavelet plots of the coordination that occurred between the lateral movements of pianists' right forearms in (Figures 1A,B). Figure 1A displays the coordination that occurred between the pianists when instructed to play along to an ostinato backing track together in perfect synchrony. The ostinato backing track contains a melodic phrase consisting of four ascending chords (Cm11; BbM7/D, EbM7#11, Fadd4) that is repeated every 4 s. Accordingly, the cross wavelet plot reveals a high degree of coherence (i.e., red) and in-phase coordination (right pointing arrows) at the 4-second interval. Figure 1B is a cross wavelet plot of the right arm movement of the same musicians instructed to improvise with one another over the ostinato track. As one would expect, there is much less coherence and stable in-phase behavior. However, musicians still exhibit pockets of coordinated behavior, particularly at the spectral scale (y-axis) of 8 to 16-s. Because the 4-s melodic phrase in the ostinato track repeats four times (a total interval of 16 s) this indicates that the musicians treated this as a meaningful unitinterval and transitioned to new musical phrases at divisions of this temporal unit. That is, the musicians moved their hands so they could play new keys currently out of reach at this timescale, thus initiating similar lateral hand movements across the keyboard. This coordination can then be used to compare the dynamics that emerge as a function of the musical context: Figure 2 (Left) shows the coordination of the musician's left arms while improvising over the ostinato track, and Figure 2 (Right) was captured while the musicians were improvising with a drone backing track, consisting of one pair of chords (D and A of second lowest octave) played continuously for the duration of the performance. The drone track as compared to the ostinato lacks melodic and rhythmic structure, thus these backing tracks represent two different levels of complexity in the musical context, constraining themusicians' behavior in different ways. As a result they gave rise to different patterns of inter-musician movement coordination. Capturing patterns of synchronization across multiple time scales of musical movements is useful not only in the case of the hand, but for the oscillatory motions of other limbs which may initially be considered more gestural or peripheral to musical production. In his book TheWays of the Hand, David Sudnow documents in detail his experience training and developing the ability to improvise jazz on the piano. He recognizes a key turning point in his skill development to be observing performances by the New York jazz piano player Jimmy Rowles. He describes: "I watched him night after night, watched him move from chord to chord with a broadly swaying participation of his shoulders and entire torso, watched him delineate waves of movement, some broadly encircling, others subdividing the broadly undulating strokes with finer rotational movements. . . As his foot tapped up and down his head went through a similar rotational course, and the strict up-and-down tapping of the foot was incorporated in a cyclical manner of accenting his bodily movements. In an anchored heel you could see only the up-and-down movements FIGURE 2 | Cross wavelet analysis of experimental data from two piano players improvising with an ostinato backing track (Left) and drone backing track (Right). (A,B) display the normalized time series of the lateral movements of the musicians' left hands. (C) Cross wavelet analysis of these two time series displaying the strength of coherence at each period (red for high coherence, dark blue for low to no coherence), as well as relative phase angle (right arrows equal in-phase coordination, left arrows equal anti-phase coordination). Frontiers in Psychology | www.frontiersin.org 5 April 2015 | Volume 6 | Article 313 Walton et al. Multiple musical bodies of the foot, but in the accompanying head rotation and shoulder swaying you could see a circularly undulating flow of motion. . ." Sudnow (1978, p. 82) Sudnow (1978) goes on to explain how after observing the full spectrum of Jimmy Rowles's bodily articulations, he was able imitate these dynamics in his own playing to produce similar musical qualities. Cross wavelet spectral analysis provides tools to take these eloquent descriptions of performers' movements and evaluate quantitatively the relationships between the rotational movements of the different limbs – how they encircle and subdivide one another to produce the "undulating flow of motion" of musical production (Sudnow, 1978, p. 82). It can be used to explore differences in frequency and patterning of limb movements with relationship to their performative function: for example the left hand which plays more accompanying parts can be compared to the right handwhich often engages in melodic leads, or the movement of the foot while tapping along with the beat as compared to when it is engaged in pressing a sustain pedal. Figure 3 compares the results of a cross wavelet analysis performed on the coordination of musician's up-and-down head movements (Figure 3A) with that of the up-and-down movements of their right forearms (Figure 3B). For this trial the musician's head movements are more highly coordinated than the up-and-down movements of the hands, at a much faster time scale. While the movements of the hands may be considered more functionality relevant for musical production, velocity of headmovements have been found to play a large role in performance expressivity (Castellano et al., 2008; Juchniewicz, 2008). Further exploring these dynamics can reveal the role this movement plays in how musicians spontaneously coordinate their playing behavior within improvised performance. Non-linear time series methods make possible detailed examinations of how the dynamics of movement coordination between improvising musicians unfold across the time span of musical performance. Observing how and when stable patterns in these dynamics emerge and evolve provides new possibilities for exploring the skill of improvisation, as well what dynamics contribute to more successful musical performance. There is a large body of work dedicated to examining the brain activity that occurs during improvisation (Limb and Braun, 2008; Donnay et al., 2014; Beaty, 2015 for review), but as Sudnow (1978, p.146) explains, "to define jazz is to describe the body's ways"– a body that is not only a brain. The role of the approach introduced here is to assure that experimental investigations do not miss out on the full spectrum of coordination and joint actions essential to musical communication, and to provide tools for capturing the way that musicians interact with each other. Notice, for example, focusing just on brain activity or note production would have missed the surprising coordination patterns found in head movements, and the ways that these differ from the coordination patterns of the musicians' right hand movements. Observing how the dynamics evolve within the performance and how different manipulations of the performance context (i.e., backing track) change these dynamics, can help develop predictions about how within spontaneous musical exchanges performers can successfully anticipate and generate expectations for future musical events for each other to actualize. Self-Organization of Musical Meaning When a jazz trio plays an improvisational piece their actions become so tightly coordinated and their decisions so seamlessly intertwined that the trio behaves as a single synergistic system rather than a collection of individuals. The principles of dynamical self-organization provide the language with which to describe the way performers exploit "the constraints and the allowances of the natural timescales of the body and the brain as a total physical system" (Iyer, 2008, p. 276). In live improvisation, performers must simultaneously be both producers and receivers of musical signs, the bodies of the musicians telling stories to their co-improvisers. That is, each individual improviser allows her activity to be constrained by the sonic and kinesthetic results of the activities of the other improviser. When coupled together during musical performance, their signal producing and signal FIGURE 3 | Cross wavelet analysis of experimental data from two piano players improvising with a swing backing track. (A) Displays coordination of the musician's upward and downward head movements, while (B) displays the coordination of the upward and downward movements of the musicians' right hands. Frontiers in Psychology | www.frontiersin.org 6 April 2015 | Volume 6 | Article 313 Walton et al. Multiple musical bodies FIGURE 4 | Macroscopic and microscopic interaction involved in musical improvisation. (A) Structural changes in visual and auditory information about co-performers actions at both local and global levels serve to constrain musical produce. (B) Adapted from Kugler and Turvey (1987), Illustrates the interaction between the micro and macroscopic scales, here the flow field of information refers to a the time-evolving structures of sound and light that are informative about current, future and past actions of the musicians as a group. receiving processes not only overlap, but serve as constraints on one another– allowing them to produce more complex dynamics of musical meaning. This improvising collective exists only so long as the individual improvisers work to constrain one another, and allow the work of others to constrain them. Instead of being concerned with the infinite possibilities available for musical expression in improvisatory performance, one can investigate how continuous information about the coperformer's actions constrains, or limits, the range of expression a musician will produce when engaged in such coordination. As illustrated in Figure 4, the macroscopic musical performance that emerges during improvisation is both a result of the action as well as induces structure in auditory and visual information that further shapes the performances of the musicians. Figure 4A illustrates how the strength and relative phase of inter-musician coordination at the microscopic levels of the fingers, waist, or head movements generates visual and auditory structure, and this structure is then detected by the co-performer and thus constrains their musical performance (Figure 4B). The application of cross wavelet spectral analysis to quantify coordination at both macro and microscopic spatiotemporal scales is just one step toward understanding how and when musicians detect and exploit multi-modal information about coperformers while improvising. Of course, attempting to understand behavior as it is situated within the context of the brain, body and environment introduces substantial variation. Yet these methods for analyzing complex dynamical systems allow for enlightening observations of how informational changes within even quite complex performance contexts affect the dynamics that emerge. Conclusion We have proposed new ways of investigating how musicians are able to spontaneously coordinate their musical movements to produce something never seen or heard before. The methods of complex dynamical systems introduce new tools with which to investigate this impressive ability for novelty, and suggest new possibilities for experimental investigation. It is important to recognize that these patterns of movement coordination might be considered merely an artifact or result of some cognitive ability, such as the conceptual knowledge base described by Berkowitz. Yet substantive accounts of the supposed neurocognitive structures that serve as the substrates for this conceptual knowledge are remarkably thin on the ground. And, increasingly, there is reason to think that other approaches may prove fruitful. Van Orden et al. (2012) tells the story of Mike the headless chicken, who despite an accidental beheading, lived and grew for 18 months, sustained by meals administered through an eye dropper. Not only did Mike live, but was able to demonstrate the same range of body movement and coordination, without the help of the central nervous system. They claimed that Mike demonstrated how the brain might play a more "blue-collar role" in determining behavior than normally assumed, the body filling a more "white-collar" role (Van Orden et al., 2012, p. 1). And while this is not to suggest that improvising musicians are so many headless chickens, it is to say that there is much sophistication to be uncovered in the spatiotemporal processes of musicians' bodily coordination. Understanding musicians as a self-organized system, coupled such that they constrain each other's musical performance, provides an initial path for harnessing the complexity of what seems like an overwhelming task requiring magical skills. The theoretical and methodological approach outlined here allows us to see how musical meaning emerges from the coordinated, yet complex turn taking manifested in spontaneous musical expression. Acknowledgments We would like to thank musicians Adam Petersen and Joshua Jessen, as well as sound engineer Ben Sloan. Without their Frontiers in Psychology | www.frontiersin.org 7 April 2015 | Volume 6 | Article 313 Walton et al. Multiple musical bodies continued assistance and invaluable contributions, none of the work presented here could have been made possible. We would also like to thank Charles Coey and Auriel Washburn for their assistance with data collection and analysis, as well as Richard Schmidt for his guidance with the cross wavelet analysis. This research was supported in part by funding from the National Institutes of Health (R01GM105045) as well as the University of Cincinnati Seeman-Frakes Fund. References Agre, P. E., and Chapman, D. (1987). "Pengi: an implementation of a theory of activity," in Proceedings of the AAAI, Vol. 87 (Seattle, WA: AAAI), 268–272. Baily, J. (1985). "Music structure and human movement," in Musical Structure in Cognition, ed. I. C. P. Howell (Orlando, FL: Academic Press, Inc), 237–258. Beaty, R. E. (2015). The neuroscience of musical improvisation.Neurosci. Biobehav. Rev. 51C, 108–117. doi: 10.1016/j.neubiorev.2015.01.004 Beauvois, M. (2007). Quantifying aesthetic preference and perceived complexity for fractal melodies.Music Percept. 24, 247–264. doi: 10.1525/mp.2007.24.3.247 Berkowitz, A. (2010). The Improvising Mind: Cognition and Creativity in the Musical Moment. New York: Oxford University Press. doi: 10.1093/acprof:oso/9780199590957.001.0001 Berliner, P. (1994). Thinking in Jazz: The Infinite Art of Improvisation. Chicago: University of Chicago Press. doi: 10.7208/chicago/9780226044521.001.0001 Borgo, D. (2005). Sync or Swarm: Improvising Music in a Complex Age. New York: The Continuum International Publishing Group Inc. Castellano, G., Mortillaro, M., Camurri, A., Volpe, G., and Scherer, K. (2008). Automated analysis of body movement in emotionally expressive piano performances. Music Percept. 2, 103–119. doi: 10.1525/mp.2008.26. 2.103 Croom, A. M. (2012). Music, neuroscience, and the psychology of well-being: a précis. Front. Psychol. 2:393. doi: 10.3389/fpsyg.2011.00393 Csikszentmihalyi, M. (1990). Flow: The Psychology of Optimal Experience. New York: Harper Collins. Csikszentmihalyi,M., and Csikszentmihalyi, I. S. (eds). (1992).Optimal Experience: Psychological Studies of Flow in Consciousness. Cambridge: Cambridge University Press. Dalla Bella, S., and Palmer, C. (2011). Rate effects on timing, key velocity, and finger kinematics in piano performance. PLoS ONE 6:e20518. doi: 10.1371/journal.pone.0020518 Davies, M., Madison, G., Silva, P., and Gouyon, F. (2013). The effect of microtiming deviations on the perception of groove in short rhythms.Music Percept. 30, 497–510. doi: 10.1525/mp.2013.30.5.497 Demos, A. P., Chaffin, R., and Kant, V. (2014). Toward a dynamics theory of body movement in musical performance. Front. Psychol. 5:477. doi: 10.3389/fpsyg.2014.00477 Demos, A. P., Frank, T. D., and Chaffin, R. (2011). "Understanding movement during performance: a recurrence qualification approach," in Proceedings of the International Symposium on Performance Scinece 2011, eds A. Williamon, D. Edwards, and Lee Bartel (Utrecht: European Association of Conservatoires). Donnay, G. F., Rankin, S. K., Lopez-Gonzalez, M., Jiradejvong, P., and Limb, C. J. (2014). Neural substrates of interactive musical improvisation: an FMRI study of 'trading fours' in jazz. PLoS ONE 9:e88665. doi: 10.1371/journal.pone.0088665 Duncker, K. (1945). On problem-solving. Psychol. Monogr. 58, i-113. doi: 10.1037/h0093599 Ghiselin, B. (1952). The Creative Process. Berkeley: University of California Press. Glowinski, D., Mancini, M., Cowie, R., Camurri, A., Chiorri, C., and Doherty, C. (2013). The movements made by performers in a skilled quartet: a distinctive pattern, and the function that it serves. Front. Psychol. 4:841. doi: 10.3389/fpsyg.2013.00841 Goldman, A. (2013). Towards a cognitive–scientific research program for improvisation: theory and an experiment. Psychomusicology 23, 210–221. doi: 10.1037/pmu0000020 Grinsted, A., Moore, J. C., and Jevrejeva, S. (2004). Application of the cross wavelet transform and wavelet coherence to geophysical time series. Nonlinear Process. Geophys. 11, 561–566. doi: 10.5194/npg-11-561-2004 Hennig, H. (2014). Synchronization in human musical rhythms and mutually interacting complex systems. Proc. Natl. Acad. Sci. U.S.A. 111, 12974–12979. doi: 10.1073/pnas.1324142111 Hennig, H., Fleischmann, R., Fredebohm, A., Hagmayer, Y., and Nagler, J. (2012). The nature and perception of fluctuations in human musical rhythms. PLoS ONE 6:e26457. doi: 10.1371/journal.pone.0026457 Issartel, J., Bardainne, T., Gaillot, P., and Marin, L. (2014). The relevance of the cross-wavelet transform in the analysis of human interaction–a tutorial. Front. Psychol. 5:1566. doi: 10.3389/fpsyg.2014.01566 Issartel, J., Marin, L., Gaillot, P., Bardainne, T., and Cadopi, M. (2006). A prac-tical guide to time-frequency analysis in the study of human motor behavior: the contribution of wavelet transform. J. Mot. Behav. 38, 139–159. doi: 10.3200/JMBR.38.2.139-159 Iyer, V. (2002). Embodied mind, situated cognition, and expressive microtiming in African American music. Music Percept. 19, 387–414. doi: 10.1525/mp.2002.19.3.387 Iyer, V. (2004). "Exploding the narrative in jazz improvisation," in Uptown Conversation: The New Jazz Studies, eds R. O'Meally, B. Edwards, and F. Griffin (New York, NY: Columbia University Press), 393–403. Iyer, V. (2008). "On improvisation, temporality, and embodied experience," in Sound Unbound, ed. P. D. Miller (Cambridge, MA: MIT Press), 273–293. Juchniewicz, J. (2008). The influence of physical movement on the perception of musical performance. Psychol. Music. 36, 417–427 doi: 10.1177/0305735607086046 Keller, P. E. (2008). "Joint action in music performance," in Enacting Intersubjectivity: A Cognitive and Social Perspective to the Study of Interactions, ed. A. C. F. Morganti (Amsterdam: IOS Press), 205–221. Keller, P. E. (2012). "What movement force reveals about cognitive processes in music performance," inArt inMotion II, ed. A. Mornell (Frankfurt: Peter Lang), 115–153. Keller, P. E., and Appel, M. (2010). Individual differences, auditory imagery, and the coordination of body movements and sounds in musical ensembles.Music Percept. 28, 27–46. doi: 10.1525/mp.2010.28.1.27 Keller, P. E., Weber, A., and Engel, A. (2011). Practice makes too perfect: fluctuations in loudness indicate spontaneity in musical improvisation.Music Percept. 29, 107–112. doi: 10.1525/mp.2011.29.1.109 Kloos, H., and Van Orden, G. (2012). Abductive reasoning by children. Rev. Psychol. Front. 1:9. Kugler, P. N., and Turvey, M. T. (1987). Information, Natural Law, and the SelfAssembly of Rhythmic Movement. Mahwah, NJ: Lawrence Erlbaum Associates. Limb, C. J., and Braun, A. R. (2008). Neural substrates of spontaneous musical performance: an FMRI study of jazz improvisation. PLoS ONE 3:e1679. doi: 10.1371/journal.pone.0001679 Loehr, J. D., Large, E. W., and Palmer, C. (2011). Temporal coordination and adaptation to rate change in music performance. J. Exp. Psychol. Hum. Percept. Perform. 37, 1292–1309. doi: 10.1037/a0023102 Loehr, J., and Palmer, C. (2011). Temporal coordination between performing musicians. Q. J. Exp. Psychol. 64, 2153–2167. Maes, P.-J., Leman, M., Palmer, C., andWanderley, M. (2014). Action-based effects on music perception. Front. Psychol. 4:1008. doi: 10.3389/fpsyg.2013.01008 Nardone, P. (1997). The Experience of Improvisation in Music: A Phenomenological Psychological Analysis. Ph.D. thesis, Saybrook Institute, Oakland. Norgaard, M. (2011). Descriptions of Improvisational thinking by Artist-Level Jazz Musicians. J. Res. Music Educ. 59, 109–127. doi: 10.1177/0022429411405669 Norgaard, M. (2014). How jazz musicians improvise: the central role of auditory and motor patterns.Music Percept. 31, 271–287. doi: 10.1525/mp.2014.31.3.271 Novembre, G., and Keller, P. E. (2011). A grammar of action generates predictions in skilled musicians. Conscious. Cogn. 20, 1232–1243. doi: 10.1016/j.concog.2011.03.009 Ohlsson, S. (2011). Deep Learning. New York: Cambridge University Press. doi: 10.1017/CBO9780511780295 Palmer, C. (2013). "Music performance: movement and coordination," in The Psychology of Music, 3rd Edn, ed. D. Deutsch (Amsterdam: Elsevier Press), 405–422. Frontiers in Psychology | www.frontiersin.org 8 April 2015 | Volume 6 | Article 313 Walton et al. Multiple musical bodies Palmer, C., and Loehr, J. (2013). "Meetingof twominds in duet piano performance," in Musical implications: Essays in Honor of Eugence Narmour, ed. A. R. L. F. Bernstein (Hillsdale, NY: Pendragon Press). Pressing, J. (1998). "Psychological constraints on improvisational expertise and communication," in In the Course of Performance: Studies in the World of Musical Improvisation, ed. B. R. Nettl (Chicago, IL: The University of Chicago Press), 47–67. Pressing, J. (1999). The referential dynamics of cognition and action. Psychol. Rev. 106, 714–747. doi: 10.1037/0033-295X.106.4.714 Pressing, J. (2000). "Improvisation: methods and models," in Generative Processes in Music, ed. J. Sloboda (New York, NY: Oxford University Press), 129–178. Ragert, M., Schroeder, T., and Keller, P. E. (2013). Knowing too little or too much: the effects of familiarity with a co-performer's part on interpersonal coordination in musical ensembles. Front. Auditory Cogn. Neurosci. 4:368. doi: 10.3389/fpsyg.2013.00368 Rankin, S. K., Large, E. W., and Fink, P. W. (2009). Fractal tempo fluctuation and pulse prediction. Music Percept. 26, 401–413. doi: 10.1525/mp.2009.26. 5.401 Richardson, M. J., Dale, R., and Marsh, K. L. (2014). "Complex dynamical systems in social and personality psychology: theory, modeling and analysis," in Handbook of Research Methods in Social and Personality Psychology, 2nd Edn, eds H. T. Reis and C. M. Judd (New York, NY: Cambridge University Press). Ruiz, M., Hong, S. B., Hennig, H., Altenmüller, E., and Kühn, A. A. (2014). Long-range correlation properties in timing of skilled piano performance: the influence of auditory feedback and deep brain stimulation. Front. Psychol. 5:1030. doi: 10.3389/fpsyg.2014.01030 Sawyer, K. R. (2003).Group Creativity: Music, Theatre, Collaboration. Mahwah, NJ: Lawrence Erlbaum Associates, Inc. Schmidt, R. C., Nie, L., Franco, A., and Richardson, M. J. (2014). Bodily synchronization underlying joke telling. Front. Hum. Neurosci. 8:633. doi: 10.3389/fnhum.2014.00633 Serrà, J., de los Santos, C. A., and Andrzejak, R. G. (2011). "Nonlinear audio recurrence analysis with application to genre classification," in Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on, (Prague: Prague Congress Centre), 169–172. Serrà, J., Serrà, X., and Andrzejak, R. G. (2009). Cross recurrence quantification for cover song identification. New J. Phys. 11, 093017. doi: 10.1088/13672630/11/9/093017 Shove, P., and Repp, B. H. (1995). "Musical motion and performance: theoretical and empirical perspectives," in The Practice of Performance ed. J. Rink (Cambridge, MA: Cambridge University Press), 55–82. Smith, L. B. (2010). "More than concepts: how multiple integrations make human intelligence," in The Making of Human Intelligence, eds D. Mareschal, P. Quinn, and S. Lea (New York: Oxford University Press). Sudnow, D. (1978). Ways of the Hand. Cambridge: Harvard University Press. Thompson,W. F., Graham, P., and Russo, F. A. (2005). Seeingmusic performance: visual influences on perception and experience. Semiotica 2005, 203–227. doi: 10.1515/semi.2005.2005.156.203 Van Orden, G., Hollis, G., and Wallot, S. (2012). The blue-collar brain. Front. Psychol. 3:207. doi: 10.3389/fphys.2012.00207 Washburn, A., DeMarco, M., Simon de Vries, S., Ariyabuddhiphongs, K., Schmidt, R. C., Richardson, M. J., et al. (2014). Dancers entrain more effectively than non-dancers to another actor's movements. Front. Hum. Neurosci. 8:800. doi: 10.3389/fnhum.2014.00800 Conflict of Interest Statement: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. Copyright © 2015 Walton, Richardson, Langland-Hassan and Chemero. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. Frontiers in Psychology | www.frontiersin.org 9 April 2015 | Volume 6 | Article