grouperlab

Get, share, and use information well

Category: organizational culture

Guidance, Navigation, and Communication

This is the most normal contact I’ve had today.  Thanks for this bit of structure.

 

While this was not how or where I expected this blog entry to start, after a long absence.  However, these comments are especially notable for me, since they came not from one, but two different people in two different online meetings in two distinct research project contexts.  They were notable not because I was doing something uniquely innovative or novel, but exactly because I was doing something relatively mundane: regular weekly meetings with my students, and regularly scheduled project updates with my research team.  Yes, there were a few technical hiccups, as there often are, but for the most part, they functioned as we always expect them to function.

And that, in a nutshell, was what was most appreciated today.  I think it is no exaggeration to say that very few people alive today remember a similar period of rapid shift from normal to unprecedented, with such a sense of vertigo as we collectively stare into a social, economic, and cultural abyss.  But that is not where I want to focus my emphasis in this entry; there are plenty of places to talk about that.  I want to talk more about what we in the lab have been learning this year, which has become unexpectedly one of the most valuable possible lessons for me (and maybe others, but I will let them be the judges of that).

Fall 2019 was really busy.  I was teaching my two courses (Perspectives on Systems Engineering, or PoSE, as well as Work Analysis and Design) with a bit over 200 students in total.  Two students were finishing their dissertations (Megan on Cybersecurity Incident Response Teams, and Jordan on Spaceflight Mission Support Operations Teams), and three more grad students (and an undergrad) were joining—two from a different department with different cultures and traditions of graduate progress.  I was also faculty advisor to the professional society student chapter.  Add that to my normal level of travel (Japan in August, London in September, Washington DC and Seattle on consecutive weeks in October), and our regular habit of individual meetings (written as “1:1” in my calendar) just sort of fell by the wayside.  We were making progress overall, and I was still having (most of) our weekly GROUPER meetings, so no problem, right?

Well, not quite.  New students need orientation and support to start a new program—even if they are simply completing their BS degree and starting an MS/PhD in the same program.  The culture of a lab changes significantly when the “veterans” leave and the “newbies” come in.  If all the veterans are leaving at once (and living in other cities or even time zones as they finish), who is most responsible for managing the communication and socialization of the important aspects of the organizational culture?  The advisor, of course—even if the lab is fortunate enough (as we have been) to have a set of new student “onboarding” documents.  Thus, it was easy enough for me to think, “well, this is just a little schedule shift,” when postponing 1:1 meetings, it’s HUGE for someone just starting on a new path in a confusing feudal environment.

So, among the last gasp efforts of the overwhelming Fall semester, we made sure that we put a priority on making sure everyone had a regular 1:1 meeting, and that such meetings were a priority when possible.  (Sometimes, from February Frenzy through March Madness and April Anarchy, we might not have 1:1 meetings for everyone at their regularly scheduled time, but we know to discuss that with the travel schedule weeks in advance.)  I was even able to welcome a new international visiting student, and within her first week on campus, we had 1:1 meetings for her as well.  Everyone remember to breathe…

Within the first three weeks of the new semester starting in January 2020, the difference was obvious to the students, and to me as well.  Yes, it helped that I wasn’t teaching in the classroom (“A Professor is ALWAYS teaching!”), but each week, significant progress was being made in the crafting and focus on research projects, social and psychological development, and understanding of what I’m looking for and how to get there.  As a result, when I asked for a “Captain Kirk to Scotty” response from the lab, not only could I get one, but the response seamlessly added into the discussions of each individual’s projects as well.

Scotty-using-communicator

Figure 1.  Scotty: “I need at least three days, Captain.”  Kirk: “You’ve got an hour.”  image from https://movieplus.news/25-false-things-about-star-trek-that-everyone-believed/

Since the lab has been experiencing “distributed operations” for at least four years (remember the students in other time zones part?), we have frequently had at least one member of the lab (including me, when I was working in Washington, DC for a year) “dial in” remotely via Webex, Google Hangouts, Skype, Zoom, ….  It’s not weird, it’s just that not everyone makes it to the same room every week.  So, if there is an illness, or travel, or simply a schedule conflict, “Can we do the 1:1 remotely next Monday?  Sure.”  In essence, regular contact, regular discussion, regular updates had all become… regular.

Back in February, one of our research project teams was having its quasi-monthly meeting.  It’s hard getting people from four universities and a federal agency together for project updates, but we were able to find a mutual window in the schedule: March 23. We don’t know much else about the news and research environment ahead (our project had been already upended by a Sunday morning news story), but we do know that.  As the possible impacts of “shelter in place” and “social distancing” were discussed in early March, GROUPER made a fairly simple decision on March 11, two days before Purdue’s Spring Break: “We’ll just assume all meetings starting March 23, for the first two weeks after Spring Break, will be electronic rather than physical.” At least it seemed simple at the time.

GROUPER studies how people get, share, and use information.  We focus on elements of information sharing, knowledge exchange, and task coordination.  We’ve talked about differences between physical interactions and online communication, and how we manage and moderate our expectations of those online information flows, for over 25 years.  (See here, and here.)  But today, there was an additional value to doing things we do regularly, in a way that we could recognize as familiar and repeated.  And yes, there was a value to me as well.  Guidance and navigation aren’t just for spacecraft, but for explorers of all types; communication is not a luxury, but a human need.

 

 

Huddle Up!

(Also known as “Notes on a train,” otherwise described as the experiences of being on the Amtrak Northeast Corridor commuter rail system finishing a work task while watching the cities roll past.)

 

Although it is the middle of football season, my first thought these days when I hear the word “huddle” is not of grass-stained uniforms or winning touchdown drives, but of men and women in suits in an office or conference room with pads of paper.  They are, in fact, one of the primary ways that State Department offices keep themselves organized and updated.  I find these huddles fascinating for that reason; both the similarities and the differences compared to GROUPER meetings are critically important to me.  Yes, the leader wants to hear from everyone, and there can be moments of banter and amusing references to recent activities (including those grass-stained uniforms).  However, what differs is also important, especially as I consider what I’m learning now and what I will bring back to Purdue next year.

 

A primary difference: why is it that a weekly 9-12 person huddle at State can take as little as 20-40 minutes, or that in a schedule-fluxing day, a five-person huddle can be completed in 14 minutes?  I had a sense that the reason had something to do with the experience, expertise, and professionalism of the team members.  At first, I thought it was that these teams were not getting involved in the messiness of the scrum activity of recognizing and responding to problems; I was informed, though, that this was not correct.  Yes, there are problems, and one purpose of the huddle is to inform the leader[1] when there is a situation that needs to be “escalated” in ways that only the leader has access or resources to accomplish.  It’s not the formal structure of an agenda: most huddles I’ve attended only have advanced communication at the level of “9:15 Huddle”.

 

No, the professionalism takes a very different form: one of preparation.  I have begun to notice that, on each pad of paper, there was a set of bullet points set off and highlighted about specific topics.  In each case, these bullet points seem to evolve into “what do I want my person to know about this topic, and what is the BLUF (bottom line up front) that I can share in 10-20 seconds?”  (Lest you dismiss this style of work as old-fashioned just because it’s on paper, keep in mind that some of our meetings are held in rooms where electronic devices are not permitted.)  The leader may ask about a particular topic, or provide additional “top-down” updates, but this upward-flowing expertise is of vital importance.

 

Those who have spent time in GROUPER know that I directly address the distinctions of people, products, and projects in my interactions.  Huddles aren’t professional development focused on people, although one may hear about when someone will be out or unavailable or otherwise tasked.  There is a recognition of ongoing projects, with timelines ranging from days to months.  But there is substantial focus on products: things due this week, or tomorrow, or maybe even in a couple of hours.  (Remind me to write about “paper” sometime soon.)  Huddles usually don’t get moved due to such deadlines, although they may be shortened.  That also seems to be a fundamental aspect of the professionalism—a strong sense of, and respect for, both time and advance information as critical resources for effective recognition and response to dynamic events.

 

So, whether we are working to 2-3 day deadlines for paper, or highlighting preparation for international efforts requiring 4 months of preparation, it’s not just the product deadline cycle that drives efficiencies in huddles.  I can’t generate the type of experience that a consular officer gets when trying to evacuate citizens after an earthquake or during political instability.  But I do think there is a fundamental difference between “what do I need from my person” and “what does my person need from me” that is of significant importance here.  Good huddles tend to focus on the latter?  Stay tuned.


[1] Actually, the term “leader” is rarely used at State.  I hear “principal” a lot, and I will admit that I have a certain reluctance to t calling someone my “boss”.  So, let me use “person” as a very generic term of a member / leader in greater authority and responsibility in the huddle.

Back to School

The Labor Day holiday weekend is drawing to a close, and I have finished up my second week of the Fellowship.  Even though the start dates of the semester and my tenure here in DC were the same, I have gotten to notice how much the routines differ between the two environments.  Unlike my academic routine that can adapt and adjust based on the day of the week and the differences between class and no-class, committee and research schedules, things feel distinct here.  There is a bus I catch, most days, between 8:14 and 8:40.  On Wednesdays, there will usually be lunch with the other Fellows.  There are Monday and Thursday morning “huddle” meetings.

 

However, that is not what I notice the most from the past two weeks.  I admit that I have developed a particular appreciation for my manager.  Each day, there is a specific new thing I have to learn.  How do I send a particular type of email?  What is the formatting for this kind of documentation?  Who do I contact for this activity?  Of course, he’s seen this all before, but it’s my first time.  And it’s not like I have had 3-4 weeks of easing into the situation.  I’ve already worked on international memoranda, and meetings between embassy staff and local representatives, and sat in on planning discussions with the offices of some folks whose name might appear on someone’s bumper sticker.  (But notably, the importance of the office is communicated by an acronym, or even a single letter; the people whose names are used are names I don’t recognize, and even those names go with acronyms.)  The most appropriate phrase for this experience is one that I learned during my first few weeks as an undergrad at MIT: “Drinking from the firehose.”

 

In that environment, where I’m supposed to come up to speed quickly, it seems like a luxury to have someone check in with me as many as 3-5 times per day to help me with one task or another.  In truth, some of the help sessions seem a bit remedial, teaching me things I do already know.  But he doesn’t know that.  And more importantly, I don’t always know when something I think I know how to do isn’t exactly how this organization does it.  So, I find myself learning to be more patient when being taught, and listening all the way through the lesson.  I even have a guiding document for goals to achieve over the next month or so—distinct from a to-do list of tasks, and an in-process list of assignments.

 

One of the things that surprises me most about this firehose experience is a new-found empathy and appreciation for the situations that confront new students in the lab.  We’ve been working on SoS and PoSE conceptualizations of ICT use in the SHARK and DOLPHIN and PERCH* streams for years—why are you nodding blankly at me?  Of course.  I’ve been doing it for years.  You just got here.  I just used a bunch of acronyms—shorthand for me, incomprehensible jargon for you.  Even when we get to time for a thesis outline, or a prelim draft, or a set of PhD defense slides, it does take some reminders to recognize that two dozen years of practice and 75 or more iterations don’t get transmitted easily to someone who is experiencing it all new and in an intense, nervous state.

 

I would like to hope that this lesson comes back to Purdue with me next Fall.  For a new student, or new faculty member, each new item can be part of an overwhelming onslaught of novelty and complexity.  Maybe it won’t stay that way for long, but it feels like that now.  In the senior capstone design course I teach, I remind the students to take the time to capture those initial moments of novelty and first attempts at processing and decision making, because it will be really hard to recall those feelings (and assumptions, and senses of confusion) again later.  I can tell them that, but it was a long time since I have felt that at the level I feel it now.  It’s good to be reminded of what the first few, chaotic weeks of new experience feel like.

 

IMG_3685

Photo of Little Kern Golden Trout by Middleton and Liitschwager (1988), hanging in the C Street entrance lobby of the National Academies.

 

 

*Acronym decluttering:

SoS: Systems-of-Systems. or a description of complex systems engineering settings where individual components of an overarching system represent complex systems in their own right (such as individual aircraft, with pilots and co-pilots, in the airspace over Washington, DC while Marine One is traveling across town).

PoSE: Perspectives on Systems Engineering.  This is a course that I developed to teach about four distinct traditions of systems engineering, ranging across systems thinking, cybernetics, component-whole relations, and project management.  Only in its second iteration as a hybrid distance / on-campus course, it is one of the most subscribed courses in Engineering Professional Education (and I’m not even teaching it this semester).

ICT: Information and Communications Technology.  When I first started as a faculty member, most computers had line-by-line display screens in single colors of amber or green; email and word processors and bulletin board chat groups were the most sophisticated information exchange tools available.  Even with all of the changes in capability, it’s still important to recognize that the point of these technologies were, and are, for humans to communicate.

SHARK, DOLPHIN, PERCH:  These are designations of project areas within the research lab, referring to knowledge sharing architectures, information flow delays, and applications to healthcare delivery improvement, respectively.  Check them out at https://engineering.purdue.edu/GrouperLab/streams/.

Brand Loyalty

After two days at the IIE Annual Conference in Montréal, I was heading to Atlanta early Tuesday morning for the FAA PEGASAS Center of Excellence Annual Meeting. The FAA meeting is for briefing our program managers about our recent progress and technical results; the IIE meeting is about much more. It’s about catching up with old colleagues, prior students, and interesting ideas. I found myself presenting some of Liang’s work in a technical session chaired by one of my academic grandchildren (one of Sandra Garrett’s advisees at Clemson), and becoming an impromptu moderator at Siobhan’s presentation. But, in a dinner discussion with Siobhan and Jake, and two students from Clemson, we also discussed what seems to be another big element of the IIE Meeting: the polo shirts.

 

I have spoken and written before about GROUPER as brand, as an iconic representation and embodiment of the lab and our topics and style of applied human factors engineering and human-systems integration research / development. We have GROUPER pins, but sometimes I wonder if we need a GROUPER logo shirt. It’s always a good idea to talk to people when you get creative ideas, because I heard some interesting views over dinner. Let’s be clear: IIE Meetings are in part about branding, and presenting and highlighting particular brand is important for many of the attendees. Far from being immune, Purdue IE is one of the prime examples of blatant name recognition and placement. Since 2011, we have sponsored the badge holders for the conference, which means it looks like everyone at IIE is from Purdue. (The badge holders are actually quite nice for those of us who really are from Purdue, as they work well for carrying passports and travel documents. The name-themed, school-color holders are perhaps not quite so enjoyable for those from Ohio State or North Carolina State—whose logo has been emblazoned on hotel key cards longer than we’ve done the badge holders.) We are the home of “Rethink IE,” which is a call to consider the evolution of the profession. But there seems to be something else, and something that is not always seen as good, in pushing one’s brand too far.

 

Because I had to go directly to the FAA briefing after I get off the plane, I decided to wear my Purdue Industrial Engineering polo shirt this morning.   I also wore it at the Saturday night reception. Yes, I wore black and gold colors, and my GROUPER and Rethink IE pins (both pinned to the badge holder, on the other days of the conference. But a number of students at the IIE meeting do something I have never seen anywhere else in my conference experience. Several times I have found myself walking down the hall to a technical session, only to see a cluster of identically-clad students. For the purposes of this discussion, I’m not going to fixate on particular rivalries or comparisons. It doesn’t matter if we’re talking about the scarlet shirts with the O and buckeye leaves (Ohio State), or the white shirts with the Puerto Rican flag (University of Puerto Rico-Mayaguez), or white shirts with a red stylized boar (Arkansas).   They are proud and pleased to represent their “team” in a coherent and unitary manner. (And, as I have previously written, I get it when you talk about who’s your team.)

 

Several of the comments over dinner expressed wonder and potential worry over this form of team representation. Would it be seen as a positive sign of camaraderie to have all of the lab appear in identical shirts, or would it be considered a demonstration of excessive conformity? Both Siobhan and Liang are working in the area of healthcare (which we describe as PERCH), but even though they both have the same advisor, they’re not using the same approaches or even addressing the same types of methods. This summer, we’re also making progress on DOLPHIN and CORAL elements of information visualization and sonification (Jake’s presentation at the IIE meeting). What I didn’t expect to hear is that this is something of a recruiting advantage for a subset of people, especially those who have a set of diverse interests and unique perspectives on the changing world of humans, engineering systems, and coordinated / distributed information and expertise in teams. While the lab has grown to a size and capability that active recruiting is not a priority for us, several of our current students started out as interesting conference conversations. GROUPER is not just a recognized brand in our community, but one to which our current students and alumni/ae are very loyal. Ours is not just a university level brand highlighting Purdue, but a unique brand at the level of the individual laboratory. What increases the value of the brand is exciting and transformative research, with excellent and compelling presentations, and not just fancy polo shirts worn in unison. We do have the logos on the slides, and we do wear our GROUPER pins with pride. (However, if you really want a polo shirt anyway, do let me know.)

 

Excellence in April

After Madness, comes Anticipation. In the sports world, April is a period of eager awaiting: as baseball teams take to the field, and professional football and basketball leagues highlight their drafts of college athletes, while colleges engage in “signing day” expectations and celebrations. Winter sports crown their champions. Hopes are fulfilled, or dashed.   While academics are seen as a very different world than athletics, I really don’t see it that way. In fact, graduate research programs have their own version of “signing day,” when offers of graduate fellowships are committed, and prospective students choose their new institution, advisor, and advanced degree emphasis. I am the Chair of our Graduate Committee, and I am highly sensitive to this process, from multiple perspectives. Over 400 students applied to Purdue Industrial Engineering for the Fall 2014 semester. Just over 100 have received the “happy letter,” indicating an acceptance of the application and an invitation to become part of the Purdue Rethink IE experience. Even fewer receive a “happier letter,” which includes an offer of fellowship support. Those are extremely challenging and competitive, and represent some of our expectations of who can be an outstanding contributor—not simply within the School of IE, but at the level of the College of Engineering or the University as a whole (where many of these fellowships are decided and awarded).

 

Every Spring, we in the lab discuss the culture of the lab, and what we need to do and think and be to maintain a focus on excellence, innovation, and productivity. Several years ago, I initiated a model of “360 recruiting,” where existing members of the lab are involved with the visits of prospective students who are invited by the School of IE to spend time on the Purdue campus and explore their options at an outstanding “full-service” IE program. I don’t commit lab funds to anyone right away, for two reasons (both due to experience). Some students find, after arrival, that our projects and my advising style may not work for them. Others may be searching for a project, but in fact are searching for financial support. Neither one of those types of students can effectively contribute or be well suited to the lab, and that lack of effective matching can hurt the overall productivity of the lab. While that first reason is strategic and philosophical, the second reason is more practical. GROUPER supports student professional development, not just research output. The students are not just workers in a research machine. Thus, we might not have funding for the project that a particular student wants to do when s/he first arrives… or they may not know which project they want to pursue. As of Spring 2014, there are six PhD students in GROUPER—not one is working on the specific project they identified in their application, or thought about during their first semester on campus. Four are working over the summer at internships in industry and government. These internships, rather than “interfering” with the research, provide additional opportunities for students to explore areas of professional and research growth, and identify areas they may want to work after graduation (or not—finding out you don’t want to work somewhere is also a successful outcome of an internship).

 

Nonetheless, GROUPER feels like an elite team. We try to “draft” well, and we try to develop and promote and sustain excellence in our performance. I was very pleased to learn that two of our “hopefuls” were offered Purdue Doctoral Fellowships for Fall 2014. I’m ecstatic to have received acceptances of both offers, meaning that our next set of GROUPERs can continue a history of diversity and excellence in doctoral development. Current members of the lab are also recognized awardees. Today, I get to celebrate Omar Eldardiry’s Outstanding Service Scholarship, due in large part to his excellent work as a teaching assistant and instructor (including his support for me with the senior capstone design project course last fall). And of course, I cannot finish this entry without once again celebrating one of our “First Team All-Americans”: Michelle (Shelly) Jahn, who was awarded the NSF Graduate Research Fellowship. This makes two consecutive years that a member of GROUPER has been awarded a fellowship through the NSF GRFP. (Last year, the winner was undergraduate GROUPER Natalie Benda, who is working in Patient Safety and will be attending the University at Buffalo for her PhD.)

 

Excellence in research and student professional development. This is an ongoing source of tremendous pride, and the heart of a continuing commitment to improve how people get, share, and use information well.

Timing is Everything

Although it doesn’t always feel like it here in the lab, things are actually going very well.  The work calendar is quite full, and the project to-do lists continue to grow—not just in the number of items, but in the number of projects which require to-do items.  Three different Institutional Review Board (IRB) applications, with three different students.  Four research projects active, with two or three more coming on line.  The “March Madness” travel schedule I had last year is even worse: the lab has now officially declared it “Winter Madness” (from January 24 until March 14, there is only one week where I am not in an airport on Friday, Saturday, or Sunday of that weekend—and on March 21-24, I will be driving back from Chicago on Friday, and flying again on Monday).

 

Last Thursday, though, I was able to appreciate what some good timing could achieve.  A day earlier, I had escaped from the ice and snow storm that paralyzed the Southeast US: leaving out of western Virginia early Wednesday morning, on a rebooked flight through Detroit (all flights through Atlanta had been cancelled as of Monday evening).  I was only a few hours later arriving home than originally scheduled, even with delays and flight diversions (let’s hear it for multiple daily nonstops from Detroit to Indianapolis!).  Thursday was bright, clear, and even relatively “warm” (about 5F that morning, with a high temperature of approximately 30F) for a drive down to Bloomington, IN for a research meeting.  That research meeting was in support of one of our new grants, a project with the Purdue Center for Education and Research in Information Assurance and Security (CERIAS) to look at sensemaking, distributed expertise, and information presentation in cyberinfrastructure network operations centers.  The meeting was unexpectedly effective in highlighting both people to talk to and additional directions for the research to pursue.  A positive attitude to go down on the one nice day where my schedule permitted the trip was better than putting the trip off for later (given “Winter Madness” and the frequency of airspace-paralyzing storms, I am not thrilled about trying to create new one-day visits anytime before April).  At the end of the day, I even received one more treat derived from an awareness of good timing.  As I left the office, the nearly full moon was visible to the east, while the International Space Station was a fast-moving evening star traveling from northwest to northeast.  (No, I don’t have the orbital tracks memorized, but there are NASA websites and software apps for that.)  Yeah, that was some good timing.

 

Timing is a fairly popular subject of GROUPER research, even if there’s only been a couple of blog entries highlighting time pressure (and only one on time perception).  But the topic is never far from our mind.  In our direct research investigations, we talk about the sense of time pressure as the ratio of time required to complete a task to the time available to complete it (TR / TA), with time pressure increasing as you run out of time to finish faster than you run out of task to complete.  We worry about the challenge of the age and “freshness” of data when making decisions about the current state of a dynamic world (and what you need to do based on that state).  We consider how experts trade other resources for time, including the decision to create an interim solution (“safe mode”) to stabilize a degrading system to allow for more time to consider a better, more stable recovery and repair.  But how does that play out in the lab’s daily activities, other than a posting an ongoing (and continuing growing) list of deadlines?

 

Fortunately, we have been working on a set of very promising solutions (processes, really).  As I go through my travel schedule, the students get a strong sense of the “windows of opportunity” (time periods of available work capacity) where I can respond to a task request or help them make progress towards an external deadline.  A few months ago, I described some of my thought process in working in a distributed way on these tasks; I think in terms of a set of scaled answers to the student’s question.  In essence, my thought process and general formulation goes like this:

 

Student:  Dr. C., I need you to do xyz by time TD.

 

(If (TD – Now) is under 12 hours, I tend to get really upset.  Don’t do that.)

 

BSC:  What do I need in order to do xyz?

 

Student:  You need A, B, and Q.

 

(If I don’t have A, B, or Q, and the student doesn’t provide it at the time of the request, I tend to get really upset, Don’t do that.)

 

Then I usually try to provide one of a set of answers, ranging from:

 

  1. NO.
  2. Not by TD; the best I can do is Talt.
  3. I can do xyz’ by TD.
  4. I can do that, but can’t start until TS.
  5. Yes, working
  6. DONE.

 

What I didn’t expect was how providing this type of information to the students could actually change the style of interactions in lab.  It’s not that I declared some specific required email format, or that I would refuse to read emails that did not conform to that format.  But, within a week or two, I started noticing emails with subject lines including the words:

 

ACTION REQUIRED / REQUESTED, or

INFORMATION ONLY.

 

The body of the emails would specify details like:

 

Estimated time to complete: xxx

Date / time needed:  dd mmm yy hh:mm

 

So, rather than simply complying with a command, the students now understand my motivations, and my constraints, and my strategies for organizing my time.  I also pointed out that I try to set aside windows of time in advance for everyone—not just in the weekly 1:1 meetings (which, I confess, is much harder to achieve during the Winter Madness travel), but when I expect tasks towards external deadlines.  Knowing in advance how much time to set aside helps me with schedules, and allows for slipping in new tasks on an emergency or opportunistic basis.  It’s all part of a goal of “Better Information Now” that we have worked with in our projects with the Jet Propulsion Laboratory and the United Space Alliance.  Sometimes, it works very well, and sometimes it still needs adjustment and improvement.  But at least, we’re making progress.

 

It’s about time.

 

 

Who’s Your Team?

(After a recent entry entitled, They Got Game, you might think that this is turning just into a sports blog.  I promise: neither that entry nor this one is only, or even primarily, about sports.)

 

After a glut of sporting festivity, the college football bowl season and first round of NFL playoffs are now history.  (Because of the winter storm and “polar vortex” that deposited 10 in / 25 cm of snow, followed by temperatures of -22F / -30C, my satellite receiver has been offline since midday Sunday.  Supposedly, there was a fairly entertaining football game on Monday evening.  I hope someone enjoyed it.)  People who know me know that I’m a fairly intense sports fan, and I have followed both college and professional football (and college women’s basketball) for most of my life.  I have also lived in a number of locations and developed attachments to quite a few teams.  (I’m going to assume that at least a few current or alumni GROUPERs were pretty pleased with the outcomes of the Rose and Orange Bowls.)  So, it’s not surprising when I’m asked, Who’s your team?

 

This was an interesting philosophical question put to me by a close friend while we were watching one or another of the various games.  It became a philosophical question when it was pointed out to me that I was getting more upset at the commentary by the announcers than who was actually winning on the field.  It’s understandable to be disappointed when the team you’re rooting for is losing.  However, my friend pointed out that I was annoyed even when I wasn’t cheering specifically for one of the two teams playing on the field.  Suddenly, I realized that this might not just be about sports.  Fortunately, my friend and I prefer very analytical discussions, so we started to analyze it.  When I have a team that I feel an affiliation to (I consider them a version of “us”), I want them to win.  (If I don’t have an affiliation to the other team, I am perfectly thrilled to have “us” win by a large margin, in what might otherwise be seen as a poor matching of teams.)  But more importantly, I want the game to be exciting and entertaining.  I want the officiating to be consistent, appropriate, and responsive to the rules as they are currently in place.  (Like many fans, I comment about the officiating.  However, I also will frequently observe the penalty and announce both the penalty and penalized player, before the referee does so.  Did I mention I’ve been an intense fan for a long time?)  I don’t like it when the official misses calls.  But I will frequently accept that “we” had a bad play instead of always assuming a “bad ref” when a penalty is called against “us”.  Why is this?  If I want the referees to do their job appropriately (without bias or favoritism), I feel obliged to acknowledge and “own” our errors as well.    I respect good announcers who point out important elements of the game play.  However, I found myself profoundly upset when an announcer would shift from one bias to another just based on the most recent event, using general references that they’ve heard as “it’s generally known” or “everybody thinks that”… (Using trite catchphrases, especially with wrong or mixed metaphors, will always draw specific ire from me.)

 

This suggests that there is another level of affiliation going on; this other affiliation applies both to the active participation in research at GROUPER and the spectator role for a football game.  It’s not just about sportsmanship, although that’s part of it.  Let’s call it the search for The Better Rule, Well Applied (BRWA).  As you know, academics have their rankings, the equivalent of the Coaches’ Top 25 poll.  The analogy is pretty strong: the rankings for the top US IE graduate programs are voted on by the department heads of those IE programs.  So, I can be excited or upset that Purdue is #10.  But wait.  Let’s look at MIT, ranked #3.  I have an affiliation with MIT, so I should see them as “us,” right?  They don’t have any degree program called Industrial Engineering.  How about Stanford or Cornell?  Great universities.  But there are more people in human factors in Purdue IE than at the corresponding programs (again, not all IE) in those three universities combined.  They don’t do IE human factors.  This issue challenges how we might use the rankings.  I’m actually less concerned about our actual ranking than the distortion.  Hence, this is an issue of BRWA, not just whether we’re better than the (logically nonexistent) competition at a specific other department.

 

Over the past several years, I’ve had a number of students trying to pick their dissertation topics.  Some of the topics were exotic; others were relatively mundane.  However, I am concerned at how often a topic is considered unworthy because there’s not enough funding in that area.  “Well, you need to compete for, and obtain, competitive grant funding.  You need to show your colleagues at the highly ranked programs how much money you’re bringing in, and place your students at those programs.”  But hold on, my BRWA affiliation screams.  The program at XYZ university doesn’t, and won’t, have an opening in human factors.  My student would rather work in (and is better suited towards) industry or government than a research academic position.  Isn’t graduate training about seeking out creative and innovative solutions that push the frontiers of knowledge and understanding?  Isn’t the PhD supposed to be about supporting the student’s career development, more than mine—in other words, preparing them for what suits them, and appropriately emphasizing their strengths towards their best fitting pathway?

 

Sometimes, it feels like it is playing a different sport.  Some football folks talk about “winning at all costs”; others talk about integrity and sportsmanship.  They’re supposedly playing the same game, but in reality, they’re not.  In sports, and in research, maybe I’m not just playing for “winning”.  It feels like I’m playing for Truth.  In the lab, what sport are we playing?  Which “Game” do we need to bring?  My sport seems to be University (knowledge, understanding, career preparation), and I want to be a starter—or even captain—on the special GROUPER squad on the BRWA team.  Our team colors include Consent and Connection. …

 

This may not even be recognizable to other people.  It could sound like I’m rooting for the Montana team in the NFL playoffs.  (Um, not only is there no professional football team in state of Montana, there is no NFL team in any US state that borders on Montana.  Alberta and Saskatchewan have Canadian Football League (CFL) teams.  The CFL championship was played last November.)  How do you recruit for a team in a sport that others might not even see as the right sport to be playing?  Again, this is an interesting philosophical point.  For instance, why is the team BRWA, instead of GROUPER?  GROUPER can’t answer all questions, about all subjects—we specialize in human factors and systems engineering, and you need more than that to do well in University.  These questions aren’t irrelevant to working at Purdue in IE, even if they seem to be ignoring “reality”.  If we don’t ask the question, or consider the options, we never make our team or our sport better.

 

(By the way, the 2013 CFL Grey Cup Most Valuable Player was Kory Sheets, who was a running back for Purdue.)

Eaten up with Curiosity

The motto of all of the mongoose family is “Run and find out,” and Rikki-Tikki was a true mongoose.

–Rudyard Kipling

We find ourselves in the midst of a new academic semester, with the variety of challenges that face us in terms of schedules, task demands, and burdens both voluntarily and involuntarily shouldered.  In one sense, it is as it always has been; but for each individual, it may be the very first time of an experience that defines and influences the remainder of one’s life.  I have been thinking about this with the current configuration of GROUPER, and the need to help students make progress on existing dissertation topics or create new ones.   This is not always an easy task, and though I have gone through this process over 50 times (with over 30 MS students and 14 PhD students advised, plus the students whom I have assisted in various less formal ways) on this side of the desk, there are always elements worth learning and improving.

Maybe it is simply the number of times that an issue presents itself within the period of a few weeks that it becomes more salient, and the gap between what is and what could be becomes more evident.  Let’s assume that it may be no more than that, although a friend of mine was just mentioning today how there can be periods when one becomes much more open to insight and jumps in one’s self-learning.  But there has been something about the question, “What should I do for my research?” that has struck me in very different ways this fall than in the past.  I am asking myself different questions about my own research and career pathways; I am reminded of writings and insights from when I first arrived at Purdue.  And of course, in the senior project design course, there is always the sense of importance to get the students—so used to textbook problem configurations and well-organized linkages between the information given and the equation to use—to start creating for themselves a system definition and sense of their own active participation in defining the problem to solve as a necessary part of being an engineer.    And as an engineer myself, such gaps between what is and what could be are always met in my head with, “What do we do about it?”

And yet, there was something that I couldn’t quite bridge on my own in the conversations with the members of the lab.  Where does one go to get ideas?  How does one start the organization of facts and methods and tasks that gets one from classroom student to nascent researcher?  Over the past month, I began to see that it was not just as simple as a statement in our “1:1 meetings” (as the nearly weekly individual meetings I have with all of members of the lab are known) to go figure out an interesting question.  Interestingly enough, this recognition for me comes from a couple of sources, as I am again reminded that I don’t seem to approach the world in a way that is like most of those around me.  Apparently, there are graduate seminars taking place in departments around the country (not just engineering departments, but bench sciences, literature, philosophy, sociology…) where students are encouraged and instructed to read through a bunch of journal papers or monographs or book chapters and determine which questions still required further study.  (For the record, I took such seminars myself: it’s how I first learned, in 1985 and 1986, of Daniel Kahneman and Amos Tversky’s work on cognitive strategies or the cultural specificity of the fundamental attribution error.  I loved those papers.  I just didn’t define my dissertation that way.)

Benson Snyder, in the 1960s and 1970s, discussed a critical issue affecting higher education, one that has come to be known as “the hidden curriculum”.   (The “hidden curriculum” of the book’s title and premise is the informal sociological and socialization process of how and when to learn, not just what to learn.) This book seems to have had a very significant effect on me—not just because I have read through it multiple times (I still own a copy of the 1973 edition of the book), but because I can now see that much of the curriculum I experienced at MIT was shaped in part by the studies Snyder reports of students there 20 years prior.  As I am teaching undergraduate statistics again after several years away from teaching it (but never far away from using it), I am also freshly sensitized to the processes of how to learn, and not just what.  And this is how I started to recognize some of what I was finding vaguely concerning in the lab.

As an undergrad, one of the most telling philosophies of innovation and excellence I ever heard was one that was directly told to me as to why I had so much latitude in organizing my activities for my work-study job.  “I’ve found that it’s best to give good people resources, and then get out of their way.”  For me, that was an excellent and empowering approach, since I was never at a loss for ideas or novel approaches or unusual ways of thinking (at least ways deemed unusual by teachers or professors).  In fact, I recently came to think about this as something I found exceptionally compelling in a cartoon I saw as an adolescent: Chuck Jones’ animated version of Rikki-Tikki-Tavi, narrated by Orson Welles.   Rikki is perpetually curious, and fiercely protective, and powerful in ways that are belied by his small size and friendly interactions.  But isn’t everyone curious in this way of mongooses?  Isn’t everyone driven to “run and find out”?  Isn’t that part of the essential “inside” of every researcher?

No, says the hidden curriculum.  Students are socialized to learn which questions are the “right” questions, and these questions are “best” defined in an outside-in way.  The existing corpus defines the way the field is configured, and thus how new questions should be approached.  But wait… 60 years ago, we didn’t have plate tectonics or the cognitive revolution—just working from existing papers published in 1953 wouldn’t have gotten you there, and certainly wouldn’t have gotten you accepted within the “standard” configuration.  The same is true with statistical process analysis or scientific project management 100 years ago, or pharmacy or aerodynamics 150 years ago, or electrical and thermodynamic processes 250 years ago.  And yet, my learning and research now derives from all of those innovations.  Someone has to move beyond the standard, outside-in framework, and be ready to do the new work and meet the new challenges (and face the inevitable questions and criticisms that such an approach will engender).

It’s obvious to me now that it takes a lot more than a brief instruction to a graduate student to think in terms of the problems in the world of task environments, and interacting with people who live in those task environments.  (Although an introvert, I find it natural and obvious to talk to someone about the challenges of their work.  It’s easier for me than making other types of small talk.)  I begin to wonder, though—have I been assuming that, just by osmosis or creating a supportive environment, anyone and everyone will be “eaten up from nose to tail with curiosity,” as Kipling put it?  Might they need more help than that?

If you were expecting an answer to these questions… sadly, you will have to wait with me for that.  I’ve asked the lab to help me understand what I’m doing that’s different, and how the hidden curriculum has affected and shaped them up to this point (although I didn’t ask it of them quite that way).  But at the very least, asking the question is an important part of the process, and an essential element of making progress.  There are cobras threatening the bungalow of higher education… bringing in and raising a mongoose is not a bad idea.

Finishing with the Start in Mind

Hmm, Caldwell, that’s not how the Stephen Covey Habit goes.  Yeah, I know…

 

It’s not that the summer has parboiled my brain — I’ve had several pleasant vacations and focused quite actively on the concept of taking time for myself and prioritizing my own relaxation and recovery.  And in fact, we talk a lot in the lab about the excitement of connections and possibilities that come from having a bold imagination.  However, the steps involved with getting from being a brand new grad student to a freshly minted PhD combine a bit of imagination (beginning with the end in mind) with a lot of perseverance (focusing on the next step).  It’s great to have a great goal and imagine all sorts of wonderful outcomes… but as the Taoist Lao Tzu said, the journey of a thousand miles starts with a single step, with a focus on the ground immediately below one’s feet.

 

As a systems engineer, I also think of the world as a set of nested feedback control systems.  This weekend, I am getting ready to complete the graduation ceremony with placing the doctoral hood on my new PhD GROUPER alumna Marissa Vallette.  The joy of the weekend also has me thinking very intently about how Marissa arrived into the lab.  In our exit interview a few weeks ago, that initial meeting was the source of a very rich conversation.  Every student is different, with a unique mix of strengths and weaknesses (“opportunities for additional development”).  Marissa is one of the ones who, by all accounts, is likely to want to organize your files, keep track of the calendar, and ask several times exactly what is meant by that correction in paragraph 5 on page 73.  (This is by no means a complaint.  Sometimes, when you’re working on a dissertation, that’s exactly what you need to focus on.  And I am indebted to Marissa for taking on the role of organizing the GROUPER lab calendar and several of our lab documents for two years.)  And, please recall, GROUPER works on a somewhat unusual recruitment and selection model: existing members of the lab are strongly engaged in interviewing and providing feedback on potential new members.

 

I am amused when people ask Marissa how she started in GROUPER.  One version of the answer is that BSC passed the interview.  Yes, she started with a list of questions for me (reproduced with permission from MAV):

 

  • On average, how many years does it take to graduate an M.S. and/or Ph.D. student?
  • How many M.S. and/or Ph.D. students have you graduated?
  • How many M.S. and/or Ph.D. students do you currently advise?
  • Are you tenured?
  • How do you incorporate your background (e.g., research, industry experience) to industrial engineering?
  • What other commitments do you have both on- and off-campus?
  • What is your advising style? For instance, is it guided or un-guided?
  • What is your availability? For instance, how quickly do you respond to e-mails? How frequently would I be able to meet with you one-on-one?
  • Aside from departmental requirements, what is your philosophy on selecting a committee (for an M.S. and/or Ph.D. defense)?
  • How do you run your research lab?
  • What are your/the lab’s current research interests?
  • What are your/the lab’s current research projects?
  • What, if any, are the requirements/expectations of your graduate students? For instance, do you require them to publish journal papers and/or attend conferences? Are there lab meetings?
  • What funding opportunities are available both inside and outside your research lab?

 

Overall, not a bad set of questions, and if you are a student who considers themselves in need of a bit more “active involvement” from their advisor, you really want to get answers to these questions.   I admit that I would have had trouble answering these questions as a brand new faculty member—both because I wouldn’t have had positive answers to many of the questions, and because I wouldn’t have been able to articulate my philosophy as well then.  But, as Marissa said, it was good that a) I did have answers to these questions, and b) that I didn’t mind her asking them.  I certainly want to have a good fit and ongoing relationship with my students, and it is definitely not the case that my students are all reproductions of me.  I want that sort of interaction, and a mutual agreement on goals and priorities, because it is that sort of agreement that helps manage the rough patches of the graduate experience.

 

In retrospect, she’s not even the first (or last) member of GROUPER to have interviewed me with such questions.  For the new crops of students about to start their graduate careers in the next few weeks, I would recommend that they come up with their own list of questions, for themselves and for a potential advisor.  In the long run, my grad students can be seen as “colleagues displaced in time” (a phrase I adopted some years ago to reflect my desire to have a strong professional relationship with GROUPERs as they continue on in their careers).  In the short term, I have an exceptionally powerful and controlling role and responsibility for their progress and completion.  That’s not boastful egotism.  That is a recognition of the way academia works in a doctoral-granting research program.  In all of the research conferences I’ve attended, one of the most frequent questions asked (sometimes just after “Where’d you go to grad school?” but sometimes even before that) is “Who was your advisor?”  Those relationships are vital, and can easily make the difference in your life for decades after you leave that grad lab for the last time.  So, I am quite pleased that I was able to have this time, on this graduation weekend, to reflect on lessons I got to learn with a brand new doctoral student and her questions at the beginning of her GROUPER program.

Updating Documentation

Now that there are a few new members of the lab, it’s time to pay attention once more to making explicit some of our expectations and shared experiences.  It’s interesting to watch, and to test, how stories or catch phrases easily become part of a local culture… only to be met by blank stares when a new person experiences it.

“What’s the best dissertation?”  “The one *you* can do in a reasonable amount of time.”

“Is that a title of a song on the album?”

” Delta Pain” (which is a title of a song on the album)

All of these represent elements of tacit knowledge, in that they are shared and understood by people who were in the lab when the event occurred, or maybe in an individual meeting with me, and have learned to experience and internalize the informal lessons of the lab in a particular way.  That’s great for an individual mentoring interaction, but not really good for organizing the productivity of getting a population of students to finish high quality thesis and dissertation documents.  Thus, we have to do some of these things with more explicit intent, and a more focused and determined documentation of elements of the lab’s culture.

Since the beginning of the Spring 2013 semester, we’ve been working on this in the creation and updating of four distinct documents:  A Master’s Thesis outline; a Dissertation prelim outline (oh, even that’s tacit, or at least implicit: the proposal document written in order to describe one’s dissertation so that one can be advanced to candidacy); a Doctoral Dissertation outline… and most recently, a semester-by-semester timeline for progress towards degree completion.  These seem to be very helpful for students, and help to summarize and integrate and transmit my experience in a fairly efficient way.  And why not?  I’ve supervised over 30 MS theses and 12 PhD dissertations, and sat on committees for another 25 or more graduate documents.  Most students, on the other hand, only do this once.  (I did have one of my students complete a second MS with me after finishing a first one elsewhere; no GROUPERs have ever tried to do multiple PhD dissertations.)  Rather than make everything trial and error, or suggest that there is no pattern that leads to increased probability of success, some people (among those are many engineers) would like to have a sense of the path, the rule, the “game plan” of how this graduate experience is supposed to play out.

Does this mean that there is a fixed and rigid procedure that everyone must follow?  Of course not, for several reasons.  One is that GROUPERs are different people, with different skills.  They don’t want to work in the same stream, or using the same data collection or analysis tools, or ask the same sorts of questions.  Fortunately, I’ve worked in a bunch of areas, so my tolerance for procedure variability is fairly high–I can advise a variety of dissertations, because I have done a variety of projects in different areas and methodologies.  (Some people may think of this concept as akin to Ashby’s discussion of “Requisite Variety”; no strict quantification here is implied.)  So, the level of consistency is not at the detailed level of “you must design a three-level, two-dimensional Analysis of Variance studying the influence of…” Everyone is expected to be able to answer, “Why would anyone want to read this thesis / dissertation?”  or “Why do we care about the question, or the work you did to answer it?”

It may also be relevant that one of the recent dissertations now making its way to conclusion is specifically addressing the question of procedure reliability and complexity.  A very often-repeated task, with few new or challenging elements, can have a standard procedure that is rarely, if ever, inappropriate for completing the task as designed.  If you’re developing a brand new task that has never been tried before, it’s highly unlikely that you can write a perfect procedure on exactly how to do it.  Most procedures are somewhere in between, even if we assume the procedure is always right.  At what level should we expect a new procedure to capture all of the experience that we gain in the development of a new system?

As time goes on, all of these documents will need to be updated–not necessarily because we were wrong, but because our knowledge evolves.  (OK, I was explicitly wrong on this item. I forgot to include a version of the well-known advice: “Tell them what you’re going to tell them.  Then tell them.  Then tell them what you told them.”  In other words, the last section of the introduction chapter should include an outline of the organization of the remainder of the thesis / dissertation.)  Even the working of the updating process is a helpful way of sharing the experiences and telling the stories of the lab.  And when we’re done, current and future generations of GROUPERs can know that I won’t get upset if they haven’t taken 15 credits or completed their plan of study or research proposal by the end of their first semester in the program.  Really.

 

I know, you’re wanting the links to these documents.  They’re still under construction.  Check back when they’re done and posted.