Transcript 01/03/2012 – Learning Measurement Means getting into the Trenches

chat2lrn Welcome to #chat2lrn! Today’s discussion is about   “Measurement”. http://t.co/k9q7ufBl 15:59:01
chat2lrn Q0) Please introduce yourself who are you, where are you,   what do you do & what brings you here? #chat2lrn 16:00:50
pattishank So excited to see everyone here! #chat2lrn 16:01:27
pattishank Q0) Please introduce yourself who are you, where are you,   what do you do & what brings you here?    #chat2lrn 16:01:40
MimiBarbara RT @JudithELS: About to join chat2lrn for the next hour.   Chatting about Measurement. Please excuse all the tweets.   #chat2lrn 16:01:42
JudithELS RT @chat2lrn: Welcome to #chat2lrn! Today’s discussion is   about “Measurement”. http://t.co/k9q7ufBl 16:01:49
lesleywprice RT chat2lrn Welcome to #chat2lrn! Today’s discussion is about   “Measurement”. http://t.co/oUvYg4vn    #chat2lrn 16:01:57
lesleywprice RT @chat2lrn: Q0) Please introduce yourself who are you,   where are you, what do you do & what brings you here? #chat2lrn 16:02:04
klaceyd ‘shift your focus from <œWhat can I produce?< to <What can I change?< ‘ with a focus on org needs Kelly Meeker @opensesame   #chat2lrn 16:02:18
JudithELS RT @chat2lrn: Q0) Please introduce yourself who are you,   where are you, what do you do & what brings you here? #chat2lrn 16:02:26
pattishank q0) Patti Shank, Learning Analyst, Denver, CO, USA, Want   to learn from everyone else #chat2lrn 16:02:37
FionaQuigs Q0) Fiona Quigely, Freelance ID from Northern Ireland. I   bring hope 😉 #chat2lrn 16:02:38
MimiBarbara @JamesMcLuckie Welcome!
#chat2lrn
16:02:40
MimiBarbara Q0) Barbara Smith.    Instructional Design strategy and innovation.  Atlanta, GA. #chat2lrn 16:03:12
lesleywprice q0) Lesley Price, Loughborough UK, consultant – believe   that measuring impact is really important #chat2lrn 16:03:13
olliegardener Norwegian Ollie, now in *sunny* wales 🙂 Entrepreneur,   geek and social learning enthusiast 😉 Come here to learn #chat2lrn 16:03:18
FlashbulbJason RT @chat2lrn: Q0) Please introduce yourself who are you,   where are you, what do you do & what brings you here? #chat2lrn 16:03:22
JamesMcLuckie @MimiBarbara Thanks, Barbara. 🙂 #chat2lrn 16:03:26
pattishank @FionaQuigs Hope is the most important thing ever   #chat2lrn 16:03:27
KimSGeorge #chat2lrn Q0) Kim, Corporate comms extraordinaire 😉   @REDTRAY. Grew up in Devon, work in London. Finally joining in on my first   #chat2lrn! 16:03:30
megbertapelle RT @chat2lrn: Welcome to #chat2lrn! Today’s discussion is   about “Measurement”. http://t.co/k9q7ufBl 16:03:39
chat2lrn Q1) Measuring the ROI of learning is difficult. Should we   be concerned about it? #chat2lrn 16:03:55
pattishank RT @klaceyd: shift focus from <œWhat can I produce?< to <œWhat can I change?<  with a focus on   org needs Kelly Meeker @opensesame #chat2lrn 16:04:00
MimiBarbara Q0) Love to talk about measurement! #chat2lrn 16:04:05
FlashbulbJason I’m Jason Thurman, change management and learning   consultant from Cincinnati. Looking for new strategies to measure   ROI/outcomes #chat2lrn 16:04:06
Melissa_Venable Q0) Melissa in Miami, FL – instructional designer/blogger   w/interest in online learning.    #chat2lrn 16:04:11
lesleywprice @KimSGeorge Hi Kim….glad you could join us 🙂
#chat2lrn
16:04:18
FlashbulbJason RT @chat2lrn: Q1) Measuring the ROI of learning is   difficult. Should we be concerned about it? #chat2lrn 16:04:27
pattishank So happy to see all the new folks. Welcome!!! #chat2lrn 16:04:36
olliegardener RT @chat2lrn: Q1) Measuring the ROI of learning is   difficult. Should we be concerned about it? #chat2lrn 16:04:42
lesleywprice RT @chat2lrn: Q1) Measuring the ROI of learning is   difficult. Should we be concerned about it? #chat2lrn 16:04:49
elearningguy Q0) Mark Sheppard, L&D consultant for RCAF in snowy,   slushy Borden, ON. Here to see what’s happening with #chat2lrn 16:04:51
Melissa_Venable RT @chat2lrn: Q1) Measuring the ROI of learning is   difficult. Should we be concerned about it? #chat2lrn 16:04:57
JudithELS RT @chat2lrn: Q1) Measuring the ROI of learning is   difficult. Should we be concerned about it? #chat2lrn 16:05:04
FionaQuigs Q1) Concerned about change – yes. Let’s drop the term ROI,   it fills everyone with dread. Let’s talk the language of business #chat2lrn 16:05:09
olliegardener @FlashbulbJason Hi Jason, good to see you there 🙂   #chat2lrn 16:05:16
janet_frg @olliegardener    You’re in Wales now?  I’m behind   the times! #chat2lrn 16:05:22
klaceyd Whoops! Catching up… Q0 Kyla L&D Coordinator   @TheStrokeAssoc in London! #chat2lrn 16:05:23
pattishank @MimiBarbara I like measurement too. Looking forward to   finding out why @JudithELS doesn’t. #chat2lrn 16:05:26
olliegardener @KimSGeorge Welcome! #chat2lrn 16:05:33
klaceyd RT @chat2lrn: Q1) Measuring the ROI of learning is   difficult. Should we be concerned about it? #chat2lrn 16:05:39
pattishank RT @chat2lrn: Q1) Measuring the ROI of learning is   difficult. Should we be concerned about it? #chat2lrn 16:05:44
MimiBarbara Q1) Business partners care more about the impact metrics   than the ROI #chat2lrn 16:05:53
Melissa_Venable @elearningguy Hi Mark! Good to see you 🙂  #chat2lrn 16:05:57
owenferguson Q0) Owen from @goodpractice, joining a little late after a   head-bending technical discussion! #chat2lrn 16:06:09
FlashbulbJason Q1) I think we have to be concerned about it if we want to   continue to be employed… proving value is critical #InThisEconomy #chat2lrn 16:06:10
elearningguy Q1) we should be concerned about ROI if that’s the only   metric the “decision makers” consider important #chat2lrn 16:06:12
olliegardener @janet_frg I’m hardly the easiest to keep track of :/  #chat2lrn 16:06:13
pattishank RT @FionaQuigs: Q1) Concerned about change – yes. Lets   drop term ROI, it fills everyone with dread. Lets talk language of business   #chat2lrn 16:06:15
JamesMcLuckie Q1. I think some are concerned about the effort it takes.   Personally, I think it’s worth it. #chat2lrn 16:06:21
FlashbulbJason @olliegardener good to be back… #chat2lrn 16:06:25
lesleywprice RT @FionaQuigs: Q1) Lets drop the term ROI, it fills   everyone with dread. Lets talk the lang of business >isn’t ROI business   lang? #chat2lrn 16:06:31
JudithELS RT @FionaQuigs: Q1) Concerned about change – yes. Lets   drop the term ROI, it fills everyone with dread … >Too right! #chat2lrn 16:06:32
sparkandco Hi #chat2lrn, Holly MacDonald, on the far left coast of   Canada, will be popping in and out of today’s chat… 16:07:01
owenferguson Q1) The real question is whether ROI is as difficult to   ‘estimate’ as it’s made out to be. #chat2lrn 16:07:11
pattishank Q1) Isn’t ROI impact? #chat2lrn 16:07:15
JamesMcLuckie Q1. Agree, though, that the term ROI now has very negative   connotations.
#chat2lrn
16:07:19
lesleywprice elearningguy Q1) we should be concerned about ROI if   that’s the only metric the “decision makers” consider important >   I agree #chat2lrn 16:07:24
FlashbulbJason Q1) ROI doesn’t have to mean DIRECT ROI. It’s just as   valid to be able to prove a training outcome that affected ROI downstream   #chat2lrn 16:07:46
lesleywprice RT @JamesMcLuckie: Q1. I think some are concerned about   the effort it takes. Personally, I think its worth it. #chat2lrn 16:07:47
OpenSesame @chat2lrn Yes. We have to 1) measure our own performance   & 2) Need to demonstrate success to others to build support/interest   #chat2lrn 16:07:47
JudithELS Q1) To prove cause & effect (ROI) is virtually   impossible in most learning-focussed situations. It’s one of L&Ds gr8   myths. #chat2lrn 16:08:01
pattishank Q1) Impact measurments are needed. Except when they   aren’t. #chat2lrn 16:08:11
KimSGeorge Thank you! @lesleywprice @olliegardener Glad to be here   although may have to ‘lurk’ sometimes as am juggling lots all at once!   #chat2lrn 16:08:11
FlashbulbJason This is what I meant to say, but it took me all 130   characters… RT @pattishank: Q1) Isnt ROI impact? #chat2lrn 16:08:14
C_More_Zebras Q0) #chat2lrn Christopher Allen – Minneapolis – lurking   while working today. 16:08:18
lesleywprice RT @owenferguson: Q1) The real question is whether ROI is   as difficult to estimate as its made out to be. > good point! #chat2lrn 16:08:26
JamesMcLuckie Q1. ROI really is only one small, but significant, part of   learning evaluation. #chat2lrn 16:08:40
sparkandco Q1) measuring ROI helps to illustrate thinking logic on   impact of learning, I think back of the napkin kind of calc #chat2lrn 16:08:50
Melissa_Venable Q1) The search for some kind of standard way to measure   seems to get in the way.  #chat2lrn 16:08:52
elearningguy @pattishank Return on Learning is way more important than   $$.  Spending on L&D should be cost   of doing business #chat2lrn 16:08:52
OpenSesame @pattishank @klaceyd Thanks, Patti! I think that’s the   mindset that is more productive. We can’t ignore measurement. #chat2lrn 16:09:07
FlashbulbJason @JudithELS I agree, but it’s still so often what we’re asked   to do to prove the value of training. #chat2lrn 16:09:13
lesleywprice q1)My goodness we really have two camps here!  I am not surprised…thought this might be   the case 🙂 #chat2lrn 16:09:15
klaceyd RT @pattishank Q1) Impact measurments are needed. Except   when they aren’t. > Agree. There isn’t one rule that fits all. #chat2lrn 16:09:15
pattishank @JamesMcLuckie AGREE #chat2lrn 16:09:17
Nnetta Shall I join if I’m not exactly an L&D expert? 🙂   #chat2lrn 16:09:33
MimiBarbara @pattishank I think of impact as business metrics   improving and ROI as “was the effort worth it?”
#chat2lrn
16:09:37
klaceyd RT @JamesMcLuckie ROI really is only one small, but   significant, part of learning evaluation. > Definitely.  #chat2lrn 16:09:50
MimiBarbara RT @elearningguy: @pattishank Return on Learning is way   more important than $$.  Spending on   L&D should be cost of doing business #chat2lrn 16:09:55
JamesMcLuckie RT @JudithELS: Q1) To prove (ROI) is virtually impossible   in most  situations. > Even with   well defined *performance* outcomes? #chat2lrn 16:09:58
Melissa_Venable RT @pattishank: Q1) Impact measurments are needed. Except   when they arent. #chat2lrn 16:10:03
pattishank Some training is just CYA. Affirmative defense. No need to   measure. #chat2lrn 16:10:05
FionaQuigs Q1) Where else in business do we talk about ROI? Do we do   ROI before buying IT equipment for example? #chat2lrn 16:10:07
owenferguson Q1) We won’t know what’s making a difference if we don’t   measure it. If it’s not providing ROI and not compliance, why do it?   #chat2lrn 16:10:11
elearningguy Q1) the assumption here is that someone has done the right   kind of gap analysis. Otherwise, measurement is speculative #chat2lrn 16:10:25
MimiBarbara @Nnetta Of course!     #chat2lrn 16:10:32
pattishank @Nnetta Join!    #chat2lrn 16:10:35
JudithELS Q1) If required it’s possible to measure impact and the   possibility of learning impacting on performance but that’s not ROI #chat2lrn 16:10:36
FionaQuigs @elearningguy yes exactly – its the gap analysis that is   key, not ROI #chat2lrn 16:11:09
lesleywprice q1) is ROI different from business impact, if it has a   postive impact on performance then that surely is the ROI?
#chat2lrn
16:11:13
FlashbulbJason @fionaquigs I think smart businesses do, though some throw   money at every problem while others penny-pinch mercilessly. #chat2lrn 16:11:37
klaceyd @owenferguson But that relies on the tangibility of the   result surely. Can all learning realisitically be measurable? #chat2lrn 16:11:38
JudithELS @JamesMcLuckie The problem is proving cause & effect.   The only way this can be done is to control all the variables. #chat2lrn 16:11:44
pattishank q1 We must know impact to decide among choices. #chat2lrn 16:11:47
elearningguy @melissa_venable I agree.    We’re trying the “one size fits nobody” approach.   Measurement needs to be custom/contextual #chat2lrn 16:12:06
klaceyd @lesleywprice And I think that is key. ££and $$ cannot be   the only measure. #chat2lrn 16:12:17
olliegardener q1) Seek to improve and add value – than measure to prove   that. Don’t look at what you can measure and the decide what to do! #chat2lrn 16:12:35
owenferguson @klaceyd Not sure about learning, but performance   definitely can. I worry less about learning and more about performance. #chat2lrn 16:12:49
sparkandco Q1)I’ve always used roi as a discussion tool w/training   request – you can also identify what other factors influence perf #chat2lrn 16:12:53
FlashbulbJason RT x100 @klaceyd: @lesleywprice And I think that is key. ££and   $$ cannot be the only measure. #chat2lrn 16:12:55
elearningguy @fionaquigs We also forget about overhead costs and Total   Cost of Ownership. Everyone freaks abt Capital expense, hence ROI panic   #chat2lrn 16:13:11
FionaQuigs Q1) Before deciding an approach we need to know (1)How   much it will cost (2)if the impact is worth the cost. #chat2lrn 16:13:12
KimSGeorge Q1) Depends on definition of ROI (varies, no?) and what it   includes > this affects effort needed & people’s perceptions of it?   #chat2lrn 16:13:34
owenferguson @JudithELS or use a control group. We don’t do that nearly   enough. #chat2lrn 16:13:37
lesleywprice RT klaceyd q1) And I think that is key. ££and $$ cannot be   the only measure > agree but ROI does not just have to be money #chat2lrn 16:13:48
olliegardener RT: @elearningguy @melissa_venable Were trying “one   size fits nobody” approach. Measurement needs 2 b custom/contextual   #chat2lrn #chat2lrn 16:13:57
elearningguy Absolutely. Esp if it’s someone else’s idea. RT   @pattishank: Some training is just CYA. Affirmative defense. No need to   measure. #chat2lrn 16:14:04
JamesMcLuckie @JudithELS Q1. Surely we can create control groups.  #chat2lrn 16:14:05
JudithELS Q1) to measure ROI you have to quantify in monetary terms   the effect of learning -/- by cost of providing it. #chat2lrn 16:14:17
FlashbulbJason Q1) We can’t fall into a trap of thinking value always   means money.  #chat2lrn 16:14:27
chat2lrn Q2) What should we measure to illustrate the impact of   what we do <“ to ourselves and others? #chat2lrn 16:14:32
pattishank Isn’t “Is impact worth the cost?” ROI? #chat2lrn 16:14:48
OpenSesame @JamesMcLuckie Agree. Taking measurement seriously is only   way L&D can ensure they’ll be taken seriously organization-wide.   #chat2lrn 16:14:58
FionaQuigs @elearningguy @pattishank yes. now we are getting there!   Some things we don’t need to measure #chat2lrn 16:15:01
pattishank RT @FlashbulbJason: Q1) We cant fall into a trap of   thinking value always means money. > Agree!! #chat2lrn 16:15:04
FlashbulbJason Q1) Costco is a great value because I can get lots of food   for little $$, or I can get an expensive suitcase that lasts forever   #chat2lrn 16:15:04
JudithELS RT @owenferguson: @JudithELS or use a control group. We   dont do that nearly enough >because it’s very difficult to do. #chat2lrn 16:15:12
FlashbulbJason RT @chat2lrn: Q2) What should we measure to illustrate the   impact of what we do <“ to ourselves and others? #chat2lrn 16:15:20
lesleywprice chat2lrn Q2) What should we measure to illustrate the   impact of what we do <“ to ourselves and others? #chat2lrn 16:15:28
KimSGeorge <œ@klaceyd: @lesleywprice…££and $$ can’t be only   measure<Exactly – learning, progress, dev   of ideas & innovation too! #chat2lrn 16:15:35
elearningguy Q1) Besides, it’s not always a $$ problem. Let’s stop   using the bean counter PoV #chat2lrn 16:15:40
olliegardener RT @chat2lrn: Q2) What should we measure to illustrate the   impact of what we do <“ to ourselves and others? #chat2lrn 16:15:43
sparkandco RT @JudithELS: RT @owenferguson: or use a control group.   We dont do that nearly enough >because it’s very difficult to do.   #chat2lrn >pilot? 16:15:46
OpenSesame @owenferguson Great idea to use a control group – also   could try A/B testing with different learning initiatives #chat2lrn 16:15:48
Melissa_Venable RT @chat2lrn: Q2) What should we measure to illustrate the   impact of what we do <“ to ourselves and others? #chat2lrn 16:15:55
JudithELS RT @JamesMcLuckie: @JudithELS Q1. Surely we can create   control groups >yes but if people need learning then is that   eithical?  #chat2lrn 16:15:56
KimSGeorge RT @chat2lrn: Q2) What should we measure to illustrate the   impact of what we do <“ to ourselves and others? #chat2lrn 16:15:59
pattishank @FionaQuigs Have to measure what counts. (pun!) #chat2lrn 16:16:01
elearningguy Only with an elightened stakeholder, I think. RT   @pattishank: Isn’t “Is impact worth the cost?” ROI? #chat2lrn 16:16:09
JudithELS RT @chat2lrn: Q2) What should we measure to illustrate the   impact of what we do <“ to ourselves and others? #chat2lrn 16:16:09
klaceyd RT @chat2lrn Q2) What should we measure to illustrate the   impact of what we do <“ to ourselves and others? #chat2lrn 16:16:13
owenferguson @klaceyd I’d question the performance measures – doesn’t   quality get measured? complaints dealt with first time? #chat2lrn 16:16:25
JamesMcLuckie RT @JudithELS: yes but if people need learning then is   that eithical?  > Is it much   different from running pilots, though?    #chat2lrn 16:16:59
pattishank Q2) Business impact plus that which keeps value alive,   such as agility, service, … #chat2lrn 16:17:12
FlashbulbJason Q2) @Chat2lrn I was hoping you could tell me! #chat2lrn 16:17:18
lesleywprice sparkandco @JudithELS @owenferguson:>pilot? >elearning   has had more pilots that BA and Easyjet put together lol!! #chat2lrn 16:17:26
klaceyd @owenferguson valid point 🙂 #chat2lrn 16:17:41
JudithELS Q2) What do the stakeholders want to know? Can we provide   them with that information/measures? #chat2lrn 16:18:06
lesleywprice FlashbulbJason Q2) @Chat2lrn I was hoping you could tell   me!  > lol!! #chat2lrn 16:18:07
olliegardener Re: control group. If we believe something is hugely   valuable, limiting access = limiting impact, just in order to   “prove” it?! 😛 #chat2lrn 16:18:08
JamesMcLuckie Q2. First question should always be “What do we want   people to be able to do?” There’s a measurement right there.  #chat2lrn 16:18:08
elearningguy Q2) Measure the state of the problem solved or time in   which a change was implemented…. #chat2lrn 16:18:45
FlashbulbJason Q2) It varies so much based on the type of training. The   measure must be based on the goals of the training. #chat2lrn 16:18:51
FionaQuigs @JamesMcLuckie yes & perhaps what would happen if we don#t   #chat2lrn 16:19:01
OpenSesame Need to start with baseline data, develop quantifiable   performance objectives & figure out what learning can do to build change.   #chat2lrn 16:19:33
owenferguson @olliegardener ‘believing’ something has an impact isn’t   the same as ‘knowing’. People believe all kinds of things: astrology, etc   #chat2lrn 16:19:40
JudithELS @JamesMcLuckie For me pilots are a way of validating the   learning provision and not a measure of ROI. #chat2lrn 16:19:42
JamesMcLuckie @olliegardener In many cases it isn’t realistic to roll   out training in one go. Better to delay and do a compare/contrast.  #chat2lrn 16:20:02
elearningguy @pattishank Maybe reflective activities can help? Take the   pulse of what you learned along the way? #chat2lrn 16:20:11
klaceyd @JudithELS Q2) would stakeholders understand what   constitutes valuable measurement #chat2lrn 16:20:11
FlashbulbJason Q2) Sometimes the goal is adoption, other times   efficiency, other times satisfaction. Sometimes the goal is just to make you   think #chat2lrn 16:20:15
Nnetta @pattishank @MimiBarbara Ok, then count me in! #chat2lrn   😀 16:20:24
klaceyd @JudithELS Q2)…saying that i guess it depends on your   stakeholders! #chat2lrn 16:21:02
lesleywprice q2) what business objective  learning ie improve stock level situation   take base line then measure impact after intervention #chat2lrn 16:21:11
elearningguy @jamesmcluckie re: Q2. Agreed. We also need to measure   what they do against achievement of a business goal, I think. #chat2lrn 16:21:19
owenferguson @JudithELS re. ethical questions: same problem in   medicine. They trial medicines all the time to determine whether they work.   #chat2lrn 16:21:29
JamesMcLuckie @JudithELS Surely one method of validation is ensuring   that it’s going to be worth the £40k to roll it out?  #chat2lrn 16:21:29
FlashbulbJason Q2) In a client I support implementing new electronic   systems, the goal is often just survival. #chat2lrn 16:21:31
FionaQuigs Q2) I think there is a need for a new impact scale of measurement   e.g. like Blooms taxonomy for business efficiency #chat2lrn 16:21:35
olliegardener @owenferguson LOL! you might actually undermine the value   u r trying 2 prove. Think listenings ‘undervalued as a measurement tool  #chat2lrn 16:21:43
JudithELS @klaceyd Q2) In business terms stakeholders should know   what info they want. If they don’t then why waste time measuring? #chat2lrn 16:21:46
lesleywprice @OpenSesame q2)start with baseline data, develop   quantifiable perf objectives & figure out what learning can do to build   change. #chat2lrn 16:22:07
JamesMcLuckie RT @elearningguy: Agreed. We also need to measure what   they do against achievement of a business goal, I think. >   Absolutely.  #chat2lrn 16:22:19
FlashbulbJason Q2) Generate organizational buy-in on the goal, then   customize measurements that prove it’s being reached (or not). #chat2lrn 16:22:21
FionaQuigs @FlashbulbJason yes for many business this is a reality   now #chat2lrn 16:22:26
lesleywprice RT @FlashbulbJason: Q2) Generate orgl buy-in on the goal,   then customize measurements that prove its being reached (or not). #chat2lrn 16:23:53
klaceyd @JudithELS I think I meant more that the info they want   may not be a valuable/representative measurement.  #chat2lrn 16:24:00
MimiBarbara Q2)  Stakeholders   want to know if performance of their employees improves business metrics.
#chat2lrn
16:24:01
olliegardener q2) How about making smaller scale, step-by-step   investments instead. Agile! Listen, measure and improve underway. #chat2lrn 16:24:10
dropthepencil #chat2lrn q) 0 Tonya in NC I.D. where measurement is   everything. #chat2lrn 16:24:10
OpenSesame @klaceyd Agree! But that could be productive role for   L&D – facilitation of goal setting. #chat2lrn 16:24:28
JudithELS @JamesMcLuckie: The only way of proving whether the cost   was justified would be at the end of the entire roll-out surely?  #chat2lrn 16:24:29
FlashbulbJason Q2) It’s amazing how many organizations hold training   goals to be self-evident. Different departments have different expectations   #chat2lrn 16:24:36
Melissa_Venable RT @FlashbulbJason: Q2) Generate organizational buy-in on   the goal, then customize measurement, prove its being reached (or not)   #chat2lrn 16:24:56
chat2lrn Q3) What data-driven decisions does your department need   to make and what data is needed to make them? #chat2lrn 16:24:59
FlashbulbJason Q2) Gotta clarify those expectations first. #chat2lrn 16:25:01
elearningguy Exactly!! RT @flashbulbjason: Q2) Generate org buy-in on   goal, then customize measures that prove it’s being reached (or not).   #chat2lrn 16:25:03
lesleywprice RT @OpenSesame: @klaceyd Agree! But that could be   productive role for L&D – facilitation of goal setting. > like it!!   #chat2lrn 16:25:06
dropthepencil q2) feedback.    efficiencies.  But the bar is   raised each time. #chat2lrn 16:25:26
JamesMcLuckie @JudithELS Indeed. But you can’t estimate worth until   there has been some kind of test case. #chat2lrn 16:25:35
klaceyd RT @chat2lrn Q3) What data-driven decisions does your   department need to make and what data is needed to make them?  #chat2lrn 16:25:43
dropthepencil Having the bar raised each time makes it challenging to   measure impact. #chat2lrn 16:25:45
FlashbulbJason RT @chat2lrn: Q3) What data-driven decisions does your   department need to make and what data is needed to make them? #chat2lrn 16:25:50
olliegardener RT @chat2lrn: Q3) What data-driven decisions does your   department need to make and what data is needed to make them? #chat2lrn 16:25:53
lesleywprice RT @chat2lrn: Q3) What data-driven decisions does your   department need to make and what data is needed to make them? #chat2lrn 16:25:53
Melissa_Venable RT @chat2lrn: Q3) What data-driven decisions does your   department need to make and what data is needed to make them? #chat2lrn 16:26:04
elearningguy Here’s a generic question: Are we talking measures after   “formal trg” or looking at informal too? #chat2lrn 16:26:06
JudithELS RT @klaceyd: @JudithELS I think I meant more that the info   they want may not be a valuable/representative measurement >I agree  #chat2lrn 16:26:07
olliegardener RT @lesleywprice @OpenSesame: @klaceyd Agree! But that   could be productive role 4 L&D – facilitation of goal setting. > like   it!! #chat2lrn 16:26:20
lesleywprice RT @dropthepencil: q2) feedback.  efficiencies.  But the bar is raised each time. > as   long as efficiency doesn’t mean cuts 🙂 #chat2lrn 16:26:25
FionaQuigs @olliegardener yes – great – do “pilot” group   first – but scaled depending on initial cost/risk. i.e. if low cost intervention   #chat2lrn 16:26:50
olliegardener @elearningguy informal too! #chat2lrn 16:26:52
lesleywprice elearningguy Here’s a generic question: Are we talking   measures after “formal trg” or looking at informal too? >good   point! #chat2lrn 16:27:02
dropthepencil @lesleywprice No cuts!    No cuts! 😉 #chat2lrn 16:27:08
FlashbulbJason I have a meeting to attend and need to check out early.   Looking forward to the transcript. Thanks as always. These chats have ROI!   #chat2lrn 16:27:15
AndrewJacobsLD Apologies for being late to #chat2lrn – will catch up from   discussion so far. 16:27:17
FlashbulbJason I got @AndrewJacobsLD to take my spot… #chat2lrn 16:28:02
lesleywprice @elearninguy…how do you even know when and where   informal learning has taken place? #chat2lrn 16:28:12
olliegardener @FlashbulbJason mm… suggestions for how to measure? 🙂   ROI of #chat2lrn #chat2lrn 16:28:17
AndrewJacobsLD @FlashbulbJason Need to clarify perceptions before   expectations. #chat2lrn 16:28:18
dropthepencil biggest issue for us is the implementation of tools after   training.  Many do not implement.  Our fault, or theirs? #chat2lrn 16:28:20
FlashbulbJason Have a great weekend everyone. #chat2lrn 16:28:29
olliegardener @AndrewJacobsLD Hi Andrew 😉 #chat2lrn 16:28:37
lesleywprice RT @FlashbulbJason: I got @AndrewJacobsLD to take my   spot…> lol!!! see you next time Jason #chat2lrn 16:28:47
FionaQuigs (Q3) We need to find what helps folks to improve   performance best and then help them do that. i.e. talk to our people!   #chat2lrn 16:29:00
AndrewJacobsLD @FlashbulbJason Baton passed successfully! #chat2lrn 16:29:01
dropthepencil @FlashbulbJason backatcha!
#chat2lrn
16:29:26
lesleywprice RT @dropthepencil: biggest issue for us is the   implementation of tools after training.    > what kind of tools?? #chat2lrn 16:29:45
olliegardener @lesleywprice I dont think the aim is to measure all   learning.. but the learning initiatives invested in 😉 #chat2lrn 16:29:50
MimiBarbara RT@chat2lrn: Q3) What data-driven decisions does your   department need to make and what data is needed to make them? #chat2lrn 16:29:57
klaceyd Q3 we need to stop measuring courses and cancellations,   and start measuring knowledge and skills! #chat2lrn 16:29:58
JudithELS Q3) Has the formal learning been transferred into   workplace performance? And if not, why not? #chat2lrn 16:30:12
niallgavinuk #chat2lrn Late arrival due to Jury Service – evening all! 16:30:36
elearningguy @lesleywprice Methinks that’s the #64K question.  Is it learning or performance we measure?   #chat2lrn 16:30:39
lesleywprice RT @JudithELS: Q3) Has the formal learning been   transferred into workplace performance? And if not, why not? #chat2lrn 16:30:49
OpenSesame @dropthepencil Depends on what kind of tools! Perhaps   workers not motivated to change, but perhaps tools were not useful? #chat2lrn 16:30:54
AndrewJacobsLD @lesleywprice @dropthepencil Is a job aid designed to   support performance something that lrng can measure? #chat2lrn 16:31:00
pattishank q3) We need to see if we can make do w/ less   “courses” and use less resource-intensive interventions #chat2lrn 16:31:09
dropthepencil Another issue:    change happens so quickly now w/ the intro of new tools/ways many are   overwhelmed…difficult to modify behaviors. #chat2lrn 16:31:15
lesleywprice RT @niallgavinuk: #chat2lrn Late arrival due to Jury   Service – evening all! > Hi Niall
#chat2lrn
16:31:16
MimiBarbara Q3)  LD needs to   measure success by learners improving performance on the job. #chat2lrn 16:31:24
dropthepencil @niallgavinuk, Morning, Niall! 😉 #chat2lrn 16:31:44
pattishank RT @FionaQuigs: (Q3) We need to find what helps folks   improve performance best and help them do that. i.e. talk to our people!   #chat2lrn 16:31:53
klaceyd RT @pattishank q3) We need to see if we can make do w/   less “courses” and use less resource-intensive interventions >>   AGREE!! #chat2lrn 16:32:03
lesleywprice RT @elearningguy: Methinks thats the #64K question.  Is it learning or performance we measure?>   has to be performance #chat2lrn 16:32:03
lesleywprice RT @MimiBarbara: Q3)    LD needs to measure success by learners improving performance on the   job. >absolutely!!! #chat2lrn 16:32:15
Melissa_Venable Also implications in #highered RT @JudithELS: Q3) Has   formal learning been transferred into workplace performance? if not, why not   #chat2lrn 16:32:21
pattishank RT @olliegardener: @lesleywprice I dont think the aim is   to measure all learning.. but the learning initiatives invested in 😉   #chat2lrn 16:32:22
JudithELS RT @pattishank: q3) We need to see if we can make do w/   less “courses” and use less resource-intensive interventions >I   agree #chat2lrn 16:32:35
dropthepencil @OpenSesame fair question.    Probably some of both. #chat2lrn 16:32:35
lesleywprice RT @pattishank: RT @FionaQuigs: (Q3) . i.e. talk to our   people!> like Kelly says…get in the trenches!! #chat2lrn 16:32:49
klaceyd @JudithELS Glad we agree 🙂 Q2 #chat2lrn 16:32:53
dropthepencil @lesleywprice depends on the implementation:  education or workforce? #chat2lrn 16:33:08
olliegardener RT @lesleywprice: RT @pattishank: RT @FionaQuigs: (Q3) .   i.e. talk to our people!> like Kelly says…get in the trenches!!   #chat2lrn 16:33:22
FionaQuigs @lesleywprice @pattishank yes roll up our sleeves and get   to grips with the whole organisation #chat2lrn 16:33:37
pattishank Q3) Spend more time in the field and understand the work   #chat2lrn 16:33:51
dropthepencil @Melissa_Venable SUCH a challenging question for   #highered.  #highered sometimes   confused about its own purpose. #chat2lrn 16:34:13
AndrewJacobsLD Q3 Scale, impact, breadth of performance gap.  Expected improvement levels. Costs – money   and time. #chat2lrn 16:34:23
lesleywprice RT @FionaQuigs: @pattishank > L&D person at my last   place sat in his office all day! #chat2lrn 16:34:39
pattishank Q3) See what’s REALLY impacting work… we assume training   will help. Many times it won’t #chat2lrn 16:34:40
JamesMcLuckie @lesleywprice: RT @elearningguy Is it learning or   performance we measure?> has to be performance. > Indeed. Especially in   orgs. #chat2lrn 16:34:40
pattishank Q3) Many times we don’t understand our organizations   #chat2lrn 16:35:05
klaceyd @pattishank @olliegardener @lesleywprice is there not   value in measuring informal (‘free’) learning to give value to time spent…   #chat2lrn 16:35:10
OpenSesame @dropthepencil Got to try stuff to innovate. Sometimes   things don’t work, etc. Who cares? #chat2lrn 16:35:14
FionaQuigs @lesleywprice poor lad, how boring, lol #chat2lrn 16:35:26
lesleywprice RT @AndrewJacobsLD: Q3 Scale, impact, breadth of perf   gap.  Expected improvement levels. >   3ms..men, money, minutes 🙂 #chat2lrn 16:35:28
Melissa_Venable @dropthepencil Indeed! Yet, we forge ahead with ROI-type   questions. Especially with online learning initiatives. #chat2lrn 16:35:31
ExpertusONE Sorry 2B LOVE this! RT @pattishank: RT @olliegardener:   @lesleywprice I dont think aim to measure all learning but key initiatives   #chat2lrn 16:35:41
dropthepencil @lesleywprice Unfortunate.    Cannot be purposeful w/o knowing who you serve. #chat2lrn 16:35:47
AndrewJacobsLD @lesleywprice @FionaQuigs @pattishank At my last place the   senior mgt EXPECTED me to sit in my office to ‘train’ people 😦 #chat2lrn 16:36:01
JudithELS RT @pattishank: Q3) See whats REALLY impacting work… we   assume training will help. Many times it wont >Because it’s not needed.   #chat2lrn 16:36:02
klaceyd @pattishank @olliegardener @lesleywprice …learning and   ‘not doing your job’. i.e. definding protected time? #chat2lrn 16:36:08
KathyJeep Need to set up #chat2lrn on my calendar… perhaps I can   still jump in? 16:36:22
lesleywprice RT @OpenSesame: @dropthepencil Got to try stuff to   innovate. Sometimes things dont work, etc. > often learn more from   mistakes #chat2lrn 16:36:22
dropthepencil @Melissa_Venable I’m in the practical preparation camp;   however, I recognize that critical thinking is a practical skill. #chat2lrn 16:36:59
klaceyd @KathyJeep Definitely! We’re only at Q3! #chat2lrn 16:37:01
lesleywprice RT @KathyJeep: Need to set up #chat2lrn on my calendar…   perhaps I can still jump in? >always welcome 🙂 #chat2lrn 16:37:03
AndrewJacobsLD @lesleywprice Time and motion… 🙂 #chat2lrn 16:37:06
pattishank @JudithELS agree that many times training is a total waste   #chat2lrn 16:37:07
dropthepencil @KathyJeep always!
#chat2lrn
16:37:07
owenferguson Q3) Major challenge is to uncover what’s actually being   done vs what  we think is being done   (or should be)  #chat2lrn 16:37:09
Melissa_Venable @OpenSesame @dropthepencil Agreed! Sometimes things don’t   work. But org culture may dictate that whatever you do try must work.   #chat2lrn 16:37:14
JudithELS RT @AndrewJacobsLD: At my last place the senior mgt   EXPECTED me to sit in my office to train people 😦 >How very sad!   #chat2lrn 16:37:17
owenferguson Q3) Need a combination of data, observation &   conversation #chat2lrn 16:37:29
lesleywprice RT @KathyJeep: Need to set up #chat2lrn on my calendar…   perhaps I can still jump in? > u can catch up on transcript 🙂 #chat2lrn 16:37:30
olliegardener q3) Placing more importance on measurement & control   than indiv. experience of learning means we have lost our way! #chat2lrn 16:37:32
dropthepencil @lesleywprice no stranger to mistakes! 😉 #chat2lrn 16:37:34
JudithELS Of course you can 🙂 RT @KathyJeep: Need to set up   #chat2lrn on my calendar… perhaps I can still jump in? #chat2lrn 16:37:38
FionaQuigs Q3) The amount of money orgs spend on poor Induction   training, really gets me #chat2lrn 16:37:54
JamesMcLuckie @lesleywprice: @OpenSesame: @dropthepencil Got to try   stuff to innovate. > Need to have the courage to fail sometimes. #chat2lrn 16:37:55
chat2lrn Q4) How do your measurements link to business performance?   #chat2lrn 16:37:56
klaceyd RT @chat2lrn Q4) How do your measurements link to business   performance? #chat2lrn  #chat2lrn 16:38:25
dropthepencil @Melissa_Venable well, otherwise it’s a “waste of   time and money” 😦 #chat2lrn 16:38:30
olliegardener RT @chat2lrn: Q4) How do your measurements link to   business performance? #chat2lrn 16:38:30
niallgavinuk RT @KathyJeep Need to set up #chat2lrn on my calendar…   perhaps I can still jump in? > Do! I just did! 16:38:34
lesleywprice RT @dropthepencil:    no stranger to mistakes! 😉 lol!! me neither 😉 #chat2lrn 16:38:35
lesleywprice RT @chat2lrn: Q4) How do your measurements link to   business performance? #chat2lrn 16:38:40
ExpertusONE What to measure? Not sure if this has been said, but we’ve   seen “bus-y-ness” metrics often tracked, rather than business   impact #chat2lrn 16:38:41
pattishank @JamesMcLuckie Courage to fail… good words and hard to   do #chat2lrn 16:39:13
elearningguy I’m managing two chats here #SoMeTrainers &   #chat2lrn.  Discussing ROI. 16:39:20
AndrewJacobsLD @JudithELS I disagreed and went out and about – Learning   By Wandering Around. #chat2lrn 16:39:26
JudithELS RT @chat2lrn: Q4) How do your measurements link to   business performance? #chat2lrn 16:39:39
lesleywprice RT @ExpertusONE  Not   sure if this has been said, but we’ve seen “bus-y-ness” metrics   often tracked, rather than business impact #chat2lrn 16:39:42
pattishank q4 What do you see as “impact” metrics in your   org? #chat2lrn 16:39:50
KathyJeep RT @chat2lrn: Q4) How do your measurements link to   business performance? #chat2lrn 16:40:04
dropthepencil impact sometimes hard to measure when clients are   educators.  I measure by whether or not   I have made their lives easier. #chat2lrn 16:40:15
JudithELS RT @AndrewJacobsLD: @JudithELS I disagreed and went out   and about – Learning By Wandering Around. >Good on you 🙂 #chat2lrn 16:40:17
Melissa_Venable RT @pattishank: @JamesMcLuckie Courage to fail… good   words and hard to do #chat2lrn 16:40:21
klaceyd @elearningguy rather you than me! this with background   noise is enough for me! #chat2lrn 16:40:34
klaceyd RT @ExpertusONE Not sure if this has been said, but we’ve   seen “bus-y-ness” metrics often tracked, rather than business   impact #chat2lrn 16:40:41
dropthepencil @pattishank definitely by the answer to the q:  Is your job easier? #chat2lrn 16:40:42
lesleywprice RT @elearningguy: Im managing two chats here #SoMeTrainers   & #chat2lrn.  Discussing ROI. >split   personality 😉 #chat2lrn 16:40:48
niallgavinuk RT @elearningguy I’m managing two chats here #SoMeTrainers   & #chat2lrn.  Discussing ROI. >   Ambidextrous as well! 16:40:59
FionaQuigs Q4) Stuff like compliance training is challenging to   measure – have to do it by law and it becomes a tick box exercise #chat2lrn 16:41:09
JudithELS RT @pattishank: q4 What do you see as “impact”   metrics in your org? >That’s a key question #chat2lrn 16:41:16
ExpertusONE Curious thing, ROI & learning. So many learning folks   seem to roll eyes at it, but ROI is language that business folks speak/know   #chat2lrn 16:41:17
KathyJeep Q4) Still trying to find out what/how we measure right   now. New to my org #chat2lrn 16:41:20
JamesMcLuckie RT @pattishank: @JamesMcLuckie Courage to fail… good   words and hard to do. > Needs a lack of ego … I don’t always   manage!  #chat2lrn 16:41:22
AndrewJacobsLD Q4 We measure engagement; anything more is a mgt function.   #chat2lrn 16:41:25
olliegardener @dropthepencil @Melissa_Venable how we ever going 2 make a   diff. 2 a bus.future if can only do the stuff that worked in the past?   #chat2lrn 16:41:36
MimiBarbara Q4) LD measures at the impact level have 2 be reported by   each initiative.  There can’t be one   set of measures that work for all. #chat2lrn 16:41:45
pattishank q4) @AndrewJacobsLD: @JudithELS I LOVE learning by   wandering around!!! #chat2lrn 16:41:46
dropthepencil @niallgavinuk Obviously I’m still a newbie.  Can barely handle the one 😉 #chat2lrn 16:41:54
JamesMcLuckie @elearningguy I was going to attempt the two.   #tornbetweentwolovers #chat2lrn 16:42:00
FionaQuigs @ExpertusONE have to say not many of the business ppl I   work with talk about ROI – impact maybe and business objectives yes #chat2lrn 16:42:11
owenferguson @ExpertusONE Until the talk turns to their own department   😉 It’s not just L&D that has some challenges in this area! #chat2lrn 16:42:31
klaceyd @FionaQuigs I find compliance training easiest to measure.   In our case it’s very prescriptive-as they tick their box, i tick mine.   #chat2lrn 16:42:42
JudithELS Show off!< RT @elearningguy: Im managing two chats here   #SoMeTrainers & #chat2lrn.    Discussing ROI. #chat2lrn 16:42:59
OpenSesame @Melissa_Venable V. true. I’m lucky to work in a very   pro-experiment place. That’s why we use “pilot” so much -makes   failure ok #chat2lrn 16:43:13
lesleywprice RT @FionaQuigs: Q4) Stuff like compliance training  > but accidents and disasters still   happen so has it been effective? #chat2lrn 16:43:17
niallgavinuk #chat2lrn Q4 If it’s not in the  HR plan, then it’s not in my objectives, so   we’re not doing it! So there! 16:43:25
AndrewJacobsLD @ExpertusONE Talk business to business folks – ROI is a   term we created with smoke and mirrors. #chat2lrn 16:43:29
dropthepencil @FionaQuigs honestly, measuring ROI is an expensive   proposition, too.  Hard to stomach if   you’re not in the positive at the end. #chat2lrn 16:43:41
ExpertusONE @FionaQuigs C-Level execs live for ROI. The problem is   establishing an operational definition that is relevant & credible   #chat2lrn 16:43:45
FionaQuigs @klaceyd for sure – but its not a meaningful measure 🙂   And things still go wrong even if boxes are ticked #chat2lrn 16:43:51
elearningguy @expertusone True, but the context is very different. This   is why biz folks can’t grasp a non-$$ return. #chat2lrn 16:44:02
lesleywprice RT @niallgavinuk: #chat2lrn Q4 If its not in the  HR plan, then its not in my objectives, so   were not doing it! So there! > lol! #chat2lrn 16:44:16
JamesMcLuckie RT @niallgavinuk:    If its not in the  HR plan, then   its not in my objectives, so were not doing it! > You’re a hard man,   Niall! #chat2lrn 16:44:21
FionaQuigs @lesleywprice exactly – just look at Data Protection. I’m   sure all orgs have had DP training but things still get left on trains   #chat2lrn 16:44:46
pattishank RT @FionaQuigs: Q4) Stuff like compliance training is   challenging to measure&gt; and yet not worth measuring (except u have 2)   #chat2lrn 16:44:46
Melissa_Venable @olliegardener excellent point – sometimes a vortex   created, little real innovation or improvement if everything is low-risk   #chat2lrn 16:44:51
OpenSesame @JamesMcLuckie That’s a really hard thing – for anyone.   “celebrating failure” can be good part of culture to foster   #chat2lrn 16:44:59
klaceyd @FionaQuigs Oh completely! And that’s where focusing on   behaviour over box ticking will win every time. #chat2lrn 16:45:02
elearningguy @andrewjacobsld True, but any measurement requires an   understanding of the baseline value #chat2lrn 16:45:02
pattishank q4) How do measure leadership training, for example?   #chat2lrn 16:45:27
lesleywprice RT @elearningguy: @expertusone True, but the context is   very different.  > but surely   improved perf has an impact on bottom line? #chat2lrn 16:45:32
FionaQuigs @ExpertusONE ah yes that is true #chat2lrn 16:45:48
owenferguson @dropthepencil: … Hard to stomach if youre not in the   positive at the end > so true,  but   essential if we are to improve.    #chat2lrn 16:45:49
OpenSesame @elearningguy @expertusone I think we have to be open to   finding ways to tie L&D initiatives to a $$ return. #chat2lrn 16:45:55
FionaQuigs RT @pattishank: q4) How do measure leadership training,   for example? #chat2lrn 16:46:03
dropthepencil @pattishank truly challenging, as effective leadership   chars. differ so frequently… #chat2lrn 16:46:31
pattishank @OpenSesame @JamesMcLuckie “celebrating failure”   can be good part of culture to foster >Except when there’s too much 🙂   #chat2lrn 16:46:32
elearningguy @lesleywprice @ExpertusONE It can, but sometimes L&D   is the cost of doing business just to maintain competitive edge. #chat2lrn 16:46:53
klaceyd @pattishank Q4) it’s funny that our senior mgmt were   content with happy sheets as measure until they went on the training!   #chat2lrn 16:47:01
dropthepencil @owenferguson but only the truly innovative/inspired will   pay for it.  Either that, or educators.   #chat2lrn 16:47:13
FionaQuigs @pattishank: q4) How do measure leadership training, for   example? &gt;Has to be tied to getting business results #chat2lrn 16:47:27
elearningguy @lesleywprice …also assumes that poor performance was   the problem “training” was trying to solve. 😉 #chat2lrn 16:47:29
lesleywprice q4) re compliance…read this from Phil Green   http://t.co/umRYTJeI all had compliance training all big disasters #chat2lrn 16:47:34
AndrewJacobsLD @pattishank Ask your execs their most powerful lrng   experiences and it won’t be training related. #chat2lrn 16:47:41
chat2lrn Q5) What do learning professionals need to do to measure   more effectively? #chat2lrn 16:47:42
niallgavinuk #chat2lrn … Always assuming that the HR Plan was aligned   with the business in the first place! 16:47:50
pattishank Q4) improvement in 360 feedback? #chat2lrn 16:47:57
olliegardener @lesleywprice Problem is, as soon as you try to draw   direct lines btw concrete actions and the bottom line – the system   changes..  #chat2lrn 16:48:10
pattishank RT @chat2lrn: Q5) What do learning professionals need to   do to measure more effectively? #chat2lrn 16:48:21
lesleywprice RT @chat2lrn: Q5) What do learning professionals need to   do to measure more effectively? #chat2lrn 16:48:28
FionaQuigs @pattishank I am a little scared about 360 feedback – not   sure they work entirely well #chat2lrn 16:48:49
klaceyd RT @chat2lrn Q5) What do learning professionals need to do   to measure more effectively? #chat2lrn 16:48:55
Melissa_Venable RT @chat2lrn: Q5) What do learning professionals need to   do to measure more effectively? #chat2lrn 16:49:02
OpenSesame @pattishank @JamesMcLuckie Heh! Indeed. Def in moderation.   But can be useful to *share* failure just like you share best practices   #chat2lrn 16:49:08
AndrewJacobsLD Q5 Focus on the outcome, not the incremental steps.  Understand business results, not lrng   metrics. #chat2lrn 16:49:17
KathyJeep RT @chat2lrn: Q5) What do learning professionals need to   do to measure more effectively? #chat2lrn 16:49:28
JudithELS RT @chat2lrn: Q5) What do learning professionals need to   do to measure more effectively? #chat2lrn 16:49:36
owenferguson Q5) Measurement means getting into the data. The   profession needs more highly numerate in it to push it on. #chat2lrn 16:49:37
lesleywprice q5) get in the trenches, find out what matters to the   business and become operational managers best friend 🙂 #chat2lrn 16:49:42
elearningguy @opensesame @ExpertusONE I buy that to a degree. We have   to be careful not to make it nebulous or esoteric. Creative but accurate   #chat2lrn 16:49:42
FionaQuigs RT @AndrewJacobsLD: Q5 Focus on the outcome, not the   incremental steps.  Understand business   results, not lrng metrics. #chat2lrn 16:49:44
olliegardener RT @KathyJeep: RT @chat2lrn: Q5) What do learning   professionals need to do to measure more effectively? #chat2lrn 16:49:57
lesleywprice RT @AndrewJacobsLD: Q5 Focus on the outcome, not the   incremental steps.  Understand business   results, not lrng metrics. #chat2lrn 16:49:58
pattishank RT @OpenSesame: @JamesMcLuckie  can be useful to *share* failure just like   you share best practices&gt;IF only folks were willing 😉 #chat2lrn 16:50:05
dropthepencil The best measurement of performance is follow-up.  Don’t feel this happens enough. We need   reminders 3 mos, 6 mos later. #chat2lrn 16:50:32
ExpertusONE re: ROI – other “cost” biz functions struggled   but made progress. Example: Marketing has transformed itself by embracing   metrics #chat2lrn 16:50:43
pattishank Q5 ) like that @FionaQuigs Get beyond learning metrics   #chat2lrn 16:50:43
JamesMcLuckie RT @pattishank: RT @OpenSesame:   an be useful to *share* failure just like   best practices&gt;IF only folks willing > The big test! #chat2lrn 16:50:52
KathyJeep Q5) I think more user/job analysis is essential. I know   I’ve been woefully out of touch before #chat2lrn 16:51:13
owenferguson RT @AndrewJacobsLD: Q5 Focus on the outcome, not the   incremental steps.  Understand business   results, not lrng metrics. #chat2lrn 16:51:20
lesleywprice RT @pattishank: Q5 ) like that @FionaQuigs Get beyond   learning metrics #chat2lrn 16:51:35
ExpertusONE YES! RT @FionaQuigs: RT @AndrewJacobsLD: Q5 Focus on   outcome, not incremental steps. Understand biz results not lrng metrics   #chat2lrn 16:51:51
JudithELS Q5) Be smart, know what’s possible & what isn’t, look   at what’s really needed & why. #chat2lrn 16:51:51
OpenSesame @elearningguy @ExpertusONE I wrote about this a bit but   seems lots of L&D measurement is of “how many resources created”1/2   #chat2lrn 16:51:52
dropthepencil Following up on use of tools, best practices, etc   reinforce learning.  We often don’t   have the chance to practice. #chat2lrn 16:52:10
AndrewJacobsLD @dropthepencil Agree to a point; surely better to allow   lrnrs to follow up at their pace though, not your specified timeframe?   #chat2lrn 16:52:16
niallgavinuk #chat2lrn q5: We must engage the business in advance and   agree what ‘success’ looks like, feels, changes, costs and saves. 16:52:16
OpenSesame @elearningguy @ExpertusONE BC that’s easy to   count/control.. Rather than perf. change reflected in biz oucomes 2/2   #chat2lrn 16:52:29
KathyJeep @dropthepencil The best measurement of performance is   follow-up. &gt; So important.. performance is ongoing, and so is learning  #chat2lrn 16:52:49
FionaQuigs (Q5) We need to DRIVE it; set agreed change objectives,   related to business objectives, then verifiy. Share anything not working.   #chat2lrn 16:53:17
dropthepencil @AndrewJacobsLD definitely – but too often we don’t follow   up at all.  Time frame not as relevant   as the actual follow up itself. #chat2lrn 16:53:17
MimiBarbara RT @dropthepencil: Best measurement of performance is   follow-up.  Dont feel this happens   enough. Need reminders 3 mo, 6 mo later. #chat2lrn 16:53:21
Melissa_Venable RT @dropthepencil: Following up on use of tools, best   practices, etc reinforce learning.We often dont have the chance to practice.   #chat2lrn 16:53:23
lesleywprice RT @niallgavinukq5: We must engage the business in advance   and agree what ‘success’ looks like, feels, changes, costs and saves   #chat2lrn 16:53:25
JamesMcLuckie Q5. Need to get better at working with business to   understand and define exactly what’s needed to improve performance. #chat2lrn 16:53:27
owenferguson Q5) We can learn a lot from other disciplines like   marketing, the tech sector etc. Knowing what techniques are available is   vital #chat2lrn 16:53:29
elearningguy @opensesame Sounds like measurement by “bums in   seats” gone techno. Simple numbers are business myopia #chat2lrn 16:53:43
JudithELS RT @niallgavinuk: q5: We must engage the business in   advance and agree what success looks like, feels, changes, costs and saves.   #chat2lrn 16:53:47
dropthepencil @AndrewJacobsLD In fact, you’ve just inspired me to eat my   own dog food; will be leaving a f/up email on training we just did. #chat2lrn 16:54:00
lauraoverton @chat2lrn #chat2lrn apologies 4 late arrival – L&d   need to be comfortable in demonstrating value & sometimes that means   measurement 16:54:09
lesleywprice @niallgavinuk knowing what you want to achieve first is   just so important  #chat2lrn 16:54:10
MimiBarbara RT @JamesMcLuckie: Q5. Need 2 get better at working with   business to understand exactly what’s needed to improve performance.   #chat2lrn 16:54:35
elearningguy Q5) Know the gaps first, educate the “interpreters of   the results” and be honest about effectiveness of solution. #chat2lrn 16:54:49
pattishank RT @niallgavinuk: q5: We must engage the business in   advance and agree what success looks like, feels, changes, costs and saves.   #chat2lrn 16:54:49
ExpertusONE So TRUE! Training is an event. Learning is a process.   &gt; RT @KathyJeep: @dropthepencil Best measure of perform is follow-up   #chat2lrn 16:54:56
OpenSesame @pattishank @JamesMcLuckie    There’s no perfect answer for that… Is scary. I like this example   http://t.co/qCQGiPZV #chat2lrn 16:55:01
AndrewJacobsLD @dropthepencil But should follow up be lrnr, mgr, or lrng   team driven? Needs to be agreed at start that not all are our role. #chat2lrn 16:55:07
lesleywprice @elearningguy @opensesame when you focus on bums on seats   u are focussing on wrong end of learners 🙂 #chat2lrn 16:55:17
JudithELS RT @lauraoverton: L&d need to be comfortable in   demonstrating value & sometimes that means measurement >Couldn’t agree   more. #chat2lrn 16:55:22
elearningguy Q5) Be firm when you know trg is NOT the solution to the   problem #chat2lrn 16:55:25
klaceyd RT @JamesMcLuckie Need to get better at working with   business to understand & define exactly what’s needed to improve   performance #chat2lrn 16:55:27
lauraoverton #chat2lrn q5 demonstrating value means communicating value   as much as measuring it 16:55:36
dropthepencil @AndrewJacobsLD all of the above. #chat2lrn 16:55:42
elearningguy @lesleywprice e.g. if we rest on our laurels we are   wearing them in the wrong place? #chat2lrn 16:55:57
niallgavinuk RT @lesleywprice @niallgavinuk knowing what you want to   achieve first is just so important >; indeed. Otherwise why doing it?   #chat2lrn 16:56:00
klaceyd RT @lesleywprice @elearningguy @opensesame when you focus   on bums on seats u are focussing on wrong end of learners 🙂 #chat2lrn 16:56:02
FionaQuigs Q5) Work with all areas of the business first to establish   critical support areas, rather than thinking of training “courses”.   #chat2lrn 16:56:05
KathyJeep Q5) We need to adopt more of a business mindset and learn   to speak the language. We need to be heard. #chat2lrn 16:56:18
AndrewJacobsLD @dropthepencil Eat your own dog food…is that a good thing?   NomNom #chat2lrn 16:56:19
pattishank RT @KathyJeep: Q5) We need to adopt more of a business   mindset and learn to speak the language. We need to be heard. #chat2lrn 16:56:57
lauraoverton #chat2lrn q5 l&d need to also increase own confidence   they are adding value – then will more inclined to look for proof 16:56:58
dropthepencil @AndrewJacobsLD sometimes it’s tastier than others 😉   #chat2lrn 16:57:02
lesleywprice q5) where does talent managment fit into the   picture?….sometimes you want people to develop skills to progress to next   step #chat2lrn 16:57:02
FionaQuigs @ExpertusONE @AndrewJacobsLD you need steps and outcome –   how will you know the best route? e.g. not all steps need a   “course”. #chat2lrn 16:57:12
JudithELS Nice 1&gt; RT @lesleywprice: @elearningguy @opensesame when you focus on bums on seats u are focussing on wrong end of learners 🙂 #chat2lrn 16:57:21
KathyJeep RT @lauraoverton: #chat2lrn q5 demonstrating value means   communicating value as much as measuring it 16:57:26
olliegardener q5) listen 2 engaged workers – facilitate, enable. Listen   again. Positive? in what way? Then scale. Measure that way. Improve.   #chat2lrn 16:57:41
AndrewJacobsLD RT @KathyJeep We need to adopt more of a business mindset   and learn to speak the language… #chat2lrn >Do we market ourselves well? 16:57:59
niallgavinuk #chat2lrn Bear in mind that getting your business to act   as an “intelligent customer” can be a huge ask in the first place! 16:58:01
FionaQuigs @lesleywprice good question re where does Talent   management fit #chat2lrn 16:58:32
lesleywprice @KathyJeep RT @lauraoverton: q5 demonstrating value means   communicating value as much as measuring it > agree #chat2lrn 16:58:44
pattishank RT @lauraoverton demonstrating value means communicating   value as much as measuring it&gt; How best to communicate? #chat2lrn 16:58:53
FionaQuigs @niallgavinuk very much so – sometimes actually harder   than working with external customers #chat2lrn 16:59:05
ExpertusONE I hear ya! Easy metrics are seductive that way RT   @OpenSesame: @elearningguy @ExpertusONE BC easier count/control than perf   change #chat2lrn 16:59:08
chat2lrn Wrap) Chatting is great<¦but reflection and action   are   better. What is your <˜take   away’ from our chat?  #chat2lrn 16:59:21
Melissa_Venable RT @pattishank: RT @lauraoverton demonstrating value means   communicating value as much as measuring it > How best to communicate?   #chat2lrn 16:59:37
elearningguy @lesleywprice Talent Mgmt should be there from the outset,   but most are just about “talent aquisition”.  Mgmt is not their prob. #chat2lrn 16:59:37
JamesMcLuckie RT @OpenSesame: @pattishank I like this example   http://t.co/DwZlmO4e #chat2lrn > I like that too! 16:59:43
pattishank RT @chat2lrn: Wrap) Chatting is great<¦but reflection   and action are   better. What is your <˜take   away’ from our chat?  #chat2lrn 17:00:04
ExpertusONE Boom! RT @lesleywprice: @KathyJeep RT @lauraoverton: q5   demonstrating value means communicating value as much as measuring it   #chat2lrn 17:00:09
JamesMcLuckie RT @olliegardener: @niallgavinuk “Customer is always   right” >- nope! > LOL! #chat2lrn 17:00:15
lesleywprice RT @chat2lrn Wrap) Chatting is great<¦but reflection   and action are better. What is your <˜take away’ from our chat #chat2lrn 17:00:26
JudithELS RT @chat2lrn: Wrap) Chatting is great<¦but reflection   and action are   better. What is your <˜take   away’ from our chat?  #chat2lrn 17:00:37
KathyJeep @AndrewJacobsLD Do we market ourselves well?&gt;Not   often enough. Esp not when everyone tends to think they can do what what we   do. #chat2lrn 17:00:44
dropthepencil @JamesMcLuckie Yay! #chat2lrn 17:00:55
klaceyd RT @chat2lrn Wrap) Chatting is great<¦but reflection   and action are better. What is your <˜take away’ from our chat? #chat2lrn 17:00:55
dropthepencil @JamesMcLuckie http://t.co/oPhrEO0a  ENJOY. #chat2lrn 17:01:31
pattishank @JamesMcLuckie @OpenSesame I like this example   http://t.co/kJrKr2rL Saw that… amazing! #chat2lrn 17:01:40
OpenSesame @ExpertusONE @elearningguy In previous job I was in int’l   development. Much easier to count what WE did than change. Similar. #chat2lrn 17:01:42
KathyJeep RT @chat2lrn: Wrap) Chatting is great<¦but reflection   and action are   better. What is your <˜take   away’ from our chat?  #chat2lrn 17:01:54
JudithELS Wrap) Think I’m going to write a blog post on ROI: the   why’s & wherefores! #chat2lrn 17:02:35
elearningguy Qwrap) My take-away is a good reminder of the importance   of agreement on measurements: what/how/before/after #chat2lrn 17:02:37
FionaQuigs Wrap) Lots of different ideas of what to measure need   convergence. Conversations with ppl in your org. Agree what success means   #chat2lrn 17:02:59
olliegardener @JamesMcLuckie Never got that. I am “the   customer” all the time, 1/2 the time I havent got a clue. That’s what   cust.service is for #chat2lrn 17:03:02
ExpertusONE Yep RT @JudithELS: RT @lauraoverton: L&D need 2 be   comfortable demonstrating value sometimes it means measure > Couldnt agree   more #chat2lrn 17:03:10
olliegardener Cool! RT @JudithELS: Wrap) Think Im going to write a blog   post on ROI: the whys & wherefores! #chat2lrn 17:03:11
dropthepencil wrap)  definitely   follow-up.  So often forget best   practices, because I fail to practice them -gah-. #chat2lrn 17:03:14
Melissa_Venable Wrap) No one-size-fits-all method. Know your org:   expectations, values, needs. Communication, context, culture all key. #ROI   #chat2lrn 17:03:17
owenferguson Wrap) My take away: ROI is still a topic that we’re not   completely comfortable with. At least the debate is getting sharper.   #chat2lrn 17:03:21
JudithELS RT @pattishank: @JamesMcLuckie @OpenSesame I like this   example http://t.co/teU4U8W4 Saw that… amazing! >Excellent. #chat2lrn 17:03:26
KathyJeep QWrap) As the newbie to my org, learn more about what   measurements are already in place. Try to map to est quality measures.   #chat2lrn 17:03:29
pattishank qwrap) We need to be more focused on doing the right kinds   of measurment (and we need to learn how) #chat2lrn 17:03:47
ExpertusONE Hmmm – How should we measure the value of this chat   session? 😉 #chat2lrn 17:03:58
niallgavinuk #chat2lrn Sometimes a business gets the training it   deserves, not the training it needs #sadbuttrue 17:04:06
dropthepencil @KathyJeep and figure out what is really desired.   #chat2lrn 17:04:22
AndrewJacobsLD @FionaQuigs @ExpertusONE It’s entirely contextual based on   the topic being learnt – do we rely on paths well worn b/c its easier?   #chat2lrn 17:04:22
lesleywprice qwrap) That there are still two camps regarding ROI and we   need to understand what it means to different people #chat2lrn 17:04:24
owenferguson Wrap) I’m delighted that we didn’t have a single mention   of Kirkpatrick though … oops … #chat2lrn 17:04:57
klaceyd Wrap) Use next financial year to shift the way & the   what of defining and measuring learning! #chat2lrn 17:04:59
chat2lrn We are at an end, but don’t fret. Let’s continue the   conversation online: http://t.co/KV4aL9My #chat2lrn 17:05:01
OpenSesame +1 Need case studies to learn from! MT @owenferguson take   away: ROI is still a topic that we’re not completely comfortable with..   #chat2lrn 17:05:15
chat2lrn #chat2lrn is tackling the topic of “social learning –   a mentality” in two weeks time. A blog to get the cogs moving coming   soon… 17:05:16
olliegardener LOL! RT @owenferguson: Wrap) Im delighted that we didnt   have a single mention of Kirkpatrick though … oops … #chat2lrn 17:05:34
dropthepencil @owenferguson LOL.    awesome. #chat2lrn 17:05:37
niallgavinuk RT @JudithELS Wrap) Think I’m going to write a blog post   on ROI: the why’s & wherefores! > will read with interest! #chat2lrn 17:05:40
FionaQuigs @AndrewJacobsLD @ExpertusONE not sure what you mean…   #chat2lrn 17:05:46
JudithELS Boo&gt; RT @owenferguson: Wrap) Im delighted that we   didnt have a single mention of Kirkpatrick though … oops … #chat2lrn 17:05:55
pattishank I REALLY enjoyed all the insights… thanks SO much!
#chat2lrn
17:06:02
dropthepencil what about Phillips & Phillips?  Dang. I should have mentioned ’em earlier.   #chat2lrn 17:06:06
lesleywprice RT @ExpertusONE Hmmm – How should we measure the value of   this chat session? 😉 > I enjoyed it so it was valuable to me 🙂   #chat2lrn 17:06:07
KathyJeep Thank you for the welcome everyone! Glad I joined in, even   for a few minutes. Adding this time to my calendar now…  #chat2lrn 17:06:07
alc47 @ExpertusONE What will encourage you to come back next   time? Real measurement? #chat2lrn 17:06:13
pattishank @JudithELS Waaaaaaaaaa. #chat2lrn 17:06:33
megbertapelle RT @chat2lrn: We are at an end, but don’t fret. Let’s   continue the conversation online: http://t.co/UzuRU42f #chat2lrn 17:06:39
chat2lrn Thanks for joining #chat2lrn today! A transcript will be   posted on http://t.co/SxIyykqb. 17:06:52
martincouzins RT @niallgavinuk: #chat2lrn Sometimes a business gets the   training it deserves, not the training it needs #sadbuttrue 17:06:53
FionaQuigs @JudithELS @owenferguson kirkpatrick who? The irish always   get blamed 😉 #chat2lrn 17:06:55
pattishank RT @ExpertusONE: Hmmm – How should we measure the value of   this chat session? 😉 > You were here so it was AWESOME. #chat2lrn 17:06:59
klaceyd Thanks all!! Am off into the London sunshine before it   fades away… See you next time! #chat2lrn 17:07:05
owenferguson Some related thoughts on evaluation, ROI and control   groups on our blog http://t.co/OJmBVPnj #chat2lrn 17:07:05
AndrewJacobsLD Qwrap Make sure we’ve no pockets of using the lazy options   of measurement just because that’s the way it’s always been. #chat2lrn 17:07:05
OpenSesame @chat2lrn This was a really great conversation. Lots to   reflect on. Thanks so much, everyone! #chat2lrn 17:07:12
dropthepencil Have a great week, all! #chat2lrn 17:07:20
lesleywprice @KathyJeep…..takes place every two weeks at same time   next one 15 March 🙂 #chat2lrn 17:07:25
olliegardener RT @pattishank: I REALLY enjoyed all the insights…   thanks SO much! #chat2lrn 17:07:44
JudithELS RT @owenferguson: Some related thoughts on evaluation, ROI   and control groups on our blog http://t.co/4gWeYNuo #chat2lrn 17:08:04
lesleywprice Thanks everyone…..wow!!    What a debate that was….especially around ROI! #chat2lrn 17:08:10
megbertapelle RT @chat2lrn: …A transcript will be posted on   http://t.co/KwjlL09L. >> awesome, ’cause I’m sad I missed it! 🙂   #chat2lrn 17:08:11
martincouzins RT @chat2lrn: #chat2lrn is tackling the topic of   “social learning – a mentality” in two weeks time. A blog to get   the cogs moving coming soon… 17:08:29
niallgavinuk #chat2lrn First time I’ve joined a tweet chat half way   thru – from a pub! Liking the change. 17:08:38
JudithELS Thanks everyone, that was a really great chat 🙂   #chat2lrn 17:09:15
owenferguson Thanks for a great conversation, folks. Looking forward to   next time already. #chat2lrn 17:09:16
alc47 @niallgavinuk Whatever turns you on – sounds like not a   bad plan…… #chat2lrn 17:09:36
ExpertusONE I won’t measure value of this session by # of posts 🙂 RT   @alc47: @ExpertusONE What will encourage u to return?Real measurement? #chat2lrn 17:09:36
olliegardener RT @chat2lrn: #chat2lrn is tackling the topic of   “social learning – a mentality” in two weeks time. A blog to get   the cogs moving coming soon… 17:09:49
KathyJeep @lesleywprice Thanks! #chat2lrn 17:10:47
megbertapelle RT @chat2lrn #chat2lrn is tackling the topic of   “social learning – a mentality” in 2 weeks. Blog to get cogs moving   coming soon… #chat2lrn 17:10:49
ExpertusONE I LOVE tossing the “R” bomb in there – just to   see what happens. It’s healthy to face our fears 🙂 Thx all for insights   & convo! #chat2lrn 17:10:52
lesleywprice RT@chat2lrn: #chat2lrn is tackling the topic of   “social learning – a mentality” in 2 weeks blog to get the cogs   moving coming soon #chat2lrn 17:11:20
niallgavinuk RT @alc47 @niallgavinuk Whatever turns you on – sounds   like not a bad plan > force of circumstance Nick, but walking the talk!   #chat2lrn 17:11:21
niallgavinuk RT @alc47 @niallgavinuk Is this what we really mean by   social learning?! > Absolutely! Choice was miss opportunity or grab it!   #chat2lrn 17:14:39
klaceyd @chat2lrn I look forward to it, as always!! #chat2lrn 17:14:54
alc47 @niallgavinuk The beer or the chance to participate?   #chat2lrn 17:15:53
niallgavinuk RT @alc47 @niallgavinuk The beer or the chance to   participate? > Non-corporately, who says they’re mutually exclusive?  #tweetups #chat2lrn 17:17:39
HrzTrzPublisher RT @JamesMcLuckie: Interested in conversations to take   learning forward? Then you should join in #chat2lrn http://t.co/3FZVOLCQ 17:19:52
olliegardener RT @JamesMcLuckie: Interested in conversations to take   learning forward? Then you should join in #chat2lrn http://t.co/xxAVtZtp   #chat2lrn 17:20:48
alc47 @olliegardener Enjoy! #chat2lrn 17:23:04
DPGplc Sad to have missed @chat2lrn this week on ‘measurement’ ,   looking forward to catching up with the tweets and summary #chat2lrn 17:29:34
statweestics #chat2lrn is getting popular, +800% the last hour :   http://t.co/RWOWgJ3X 17:30:04
MikeCollins007 Looks like @chat2lrn was very interesting looking at how   we ‘measure’ learning (or is it how we don’t) #chat2lrn 17:42:38
FionaQuigs Instead of learning styles, which has little evidence of   impact why not discuss stuff which does have evidence? #chat2lrn #edchat   #lrnchat 17:51:00
lesleywprice @DPGplc  this week   on ‘measurement’ , looking forward to catching up>transcript will be on   blog Saturday/Sunday summary next week #chat2lrn 17:52:30
lesleywprice @MikeCollins007 Transcript will be on Blog on   Saturday/Sunday…summary next week 🙂 #chat2lrn 17:53:11
olliegardener Tnx 4 RTs & gr8t convos #chat2lrn @JamesMcLuckie   @niallgavinuk @Melissa_Venable @klaceyd @ExpertusONE @FionaQuigs   @owenferguson @KimSGeorge 17:55:02
megbertapelle RT @statweestics: #chat2lrn is getting popular, +800% the   last hour : http://t.co/982qUt26 >> sweet! #chat2lrn 17:56:46
FionaQuigs @olliegardener thanks to you also. Great to hear such   diverse and interesting viewpoints #chat2lrn 18:00:02
MikeCollins007 Who says us blokes can’t multi-task? RT @elearningguy I’m   managing two chats here #SoMeTrainers & #chat2lrn.  Discussing ROI. 18:01:25
JanetSymmons RT @judithels: RT @lesleywprice: @elearningguy @OpenSesame   when you focus on bums on seats u r focussing on wrong end of learners   #chat2lrn 18:15:11
lesleywprice RT @KathyJeep:    Thanks! #chat2lrn > thanks for taking part, hope you will join us   again  🙂 18:24:15
lesleywprice RT @elearningguy:    e.g. if we rest on our laurels we are wearing them in the wrong place?   #chat2lrn > I do like that one lol!!! 18:25:02
lesleywprice RT @FionaQuigs: good question re where does Talent   management fit #chat2lrn > exactly….I don’t know any ideas? 18:34:37
chat2lrn Many thanks again to @OpenSesame for a great blog post   http://t.co/XnIEN2yv for #chat2lrn today –    my goodness what a debate!!! 18:37:34
lesleywprice @FionaQuigs @olliegardener Great to hear such diverse and   interesting viewpoints > was certainly v lively!! #chat2lrn 18:48:31
lesleywprice RT @elearningguy: talent Mgmt should be there from the   outset, but most is  “talent   aquisition”.  Mgmt is not their   prob. #chat2lrn > shame! 18:53:42
lesleywprice RT @ExpertusONE: @pattishank Thx!  #chat2lrn is a rising chat star Learning   measurement is a challenge. Thx for helping us face the fire! 19:07:26
maritzavdh It could become a regular, like #lrnchat or #chat2lrn RT   @artpreston: #sateachers what about a Twitter chat one evening a week for an   hour? 19:16:10
ian_westyorks RT @EdenTreeToolkit: Interested in conversations to take   learning forward? Then you should join in #chat2lrn http://t.co/nuAYMNPB 19:35:14
Melissa_Venable Thanks for the #chat2lrn chat! @olliegardner @OpenSesame   @dropthepencil @elearningguy Have a great week. 🙂 19:58:37
ExpertusONE Just saw this Tru! > RT @dropthepencil @AndrewJacobsLD:   too often we don’t followup at all. Time frame not as relevant as doing it   #chat2lrn 20:37:35
ExpertusONE Great stuff – TY all! #chat2lrn @olliegardener   @JamesMcLuckie @niallgavinuk @Melissa_Venable @klaceyd @FionaQuigs   @owenferguson @KimSGeorge 20:41:42
martincouzins @olliegardener Enjoyed your tweets from #chat2lrn 🙂 20:52:51
ExpertusONE Still noodling on #chat2lrn THX @alc47 @FionaQuigs   @elearninguy @OpenSesame @klaceyd @lesleywprice @owenferguson @AndrewJacobsLD   #pattishank 21:02:22
lesleywprice RT @ExpertusONE: Still noodling on #chat2lrn THX  > I know..so much food for   thought…debate was brill but more questions than answers 🙂 21:15:41
KimSGeorge I may have had to lurk during most of #chat2lrn but   enjoyed seeing the conversations unfold, chatting to new contacts…&   learning! Thanks! 22:32:03
lesleywprice RT @cfidurauk In case I haven’t said it lately,   #twitterrocks. > too right had great #chat2lrn session today all about   measurement 23:36:08
pattishank @expertusone ALWAYS enjoy your insights… thanks so much   for great contributions! #chat2lrn 23:40:10
lesleywprice RT @pattishank: @expertusone ALWAYS enjoy your insights…   thanks so much for great contributions! #chat2lrn 23:40:46
elearningguy Too many names to mention but I enjoyed today’s #chat2lrn   on the ROI issue. I am richer for the exchange. 🙂 23:47:46
pattishank RT @elearningguy: I enjoyed today’s #chat2lrn on the ROI   issue. I am richer for the exchange. 🙂 >THX for your insights too. 23:49:11
lesleywprice RT @pattishank @elearningguy I enjoyed today’s #chat2lrn   on the ROI issue am richer for the exchange 🙂 >THX for your insights too >   me too! 23:57:21
lesleywprice RT @elearningguy Too many names to mention but I enjoyed   today’s #chat2lrn on the ROI I am richer for the exchange. 🙂 > was great   session! 23:59:22
lesleywprice Sometimes things just come together and work…that   happened at #chat2lrn today…different views but good debate..tks guys..and   gals lol! 00:03:28
lesleywprice RT @FionaQuigs @lesleywprice @pattishank @elearningguy   group hug 😉 #lrnchat > and #chat2lrn lol! 00:05:06
FionaQuigs @lesleywprice: RT @FionaQuigs @lesleywprice @pattishank   @elearningguy group hug 😉 #lrnchat > and #chat2lrn lol!< &gt;oops, best go to bed! 00:07:06
OpenSesame I curated today’s #chat2lrn conversation with Storify:   “Debating Learning & Training Measurement on #chat2lrn”   http://t.co/W07EER7c 01:44:13
OpenSesame @AndrewJacobsLD You’ve been quoted in my @Storify story:   “Debating Learning & Training Measurement on #chat2lrn”   http://t.co/W07EER7c 01:44:13
OpenSesame @JudithELS You’ve been quoted in my @Storify story:   “Debating Learning & Training Measurement on #chat2lrn”   http://t.co/W07EER7c 01:44:13
OpenSesame @FionaQuigs You’ve been quoted in my @Storify story:   “Debating Learning & Training Measurement on #chat2lrn”   http://t.co/W07EER7c 01:44:13
pattishank RT @opensesame: I curated today’s #chat2lrn conversation   with Storify: “Debating Learning & Training Measurement”   http://t.co/ZEhVuHi9 01:51:50
megbertapelle RT @elearningguy: Qwrap) My take-away is a good reminder   of the importance of agreement on measurements: what/how/before/after   #chat2lrn 06:34:11
JamesMcLuckie #FF to the #chat2lrn crew for a great initiative.  @lesleywprice @alc47 @JudithELS   @olliegardener @pattishank @megbertapelle 10:37:28

One thought on “Transcript 01/03/2012 – Learning Measurement Means getting into the Trenches

  1. Pingback: Learning Measurement Means Getting into the Trenches | chat2lrn

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s