251 Matching Annotations
  1. Oct 2024
    1. The learning myth downplays the role of data in developing these systems, perpetuating a related myth that data is abundant, cheap, and labor-free. These myths drive down the value of data while hiding the work of those who shape, define, and label that data. The existence of this labor can sully the tech industry’s myth of representing progress and justice through technology. The AI industry is a data industry. The less we can see the costs associated with hoarding that data, the easier for companies to justify it.

      I really like this connection here.

    2. If the prompt myth were accurate, it wouldn’t need this effort: the prompt would tell the model what we want, and it would understand it and respond in a way that meets our needs.

      Well, I'm not willing to go that far. After all we can't always communicate so perfectly with people that we don't have to clarify or make our expectations more explicit.

    1. In addition, avoid using AI to create scientific images because doing so often results in images that contain inaccuracies.

      This is so much talking out of both sides of their mouth.

    2. A crucial part of using GenAI appropriately is to ensure that its outputs are factually correct and free from errors. Always have subject-matter experts review AI-generated content and use it only as inspiration and drafts, not as final editions of what instructors would provide.

      Yeah, like that's going to happen.

      Let's just focus on the case of adjuncts—where are they goin got have the time to do this?

    3. When using ChatGPT, you can state in the query that you want the tool to provide a confidence level in the form of a percentage for the information it is giving—for example: "Please provide the information along with a percentage of your certainty."

      So… asking it to make up a number to represent certainty represents what exactly?

    4. According to a recent Microsoft and LinkedIn report, 66% of leaders surveyed indicated that they would not hire someone without AI skills

      Yes, but do we have any basis for understanding why those leaders think that? If it's based entirely on people hearing something or being told that it's important, then this is meaningless information.

    5. Compared to this expectation and from our observation, educators in the workforce fall into one of these stages:

      I object to the idea that this set of stages is correct or even desired.

    6. However, we caution that a course should not always have AI voices because it could cause a course to lose the human touch of the faculty

      But AI can simulate your own voice! Have we thought about checking what students think if they realize their prof is trying to skimp on time by having a fake voice and avatar take their place?

    7. because scientific videos require precision and accuracy that GenAI tools presently lack for our use

      But other kinds of videos DON'T REQUIRE precision and accuracy?

    8. GenAI tools are also lacking right now for creating diagrams and other visual representations of complex concepts or procedures

      This is really just a statement that in some things they accept it because it satisfies their definition of "good enough."

    9. This is the best use of GenAI for media production because it can help create a coherent storyboard, factoring in elements that the subject-matter experts might not have considered due to the complexity of their mental schemas regarding the topics to cover

      This is where the preposterousness of what's being proposed really comes through. Experts are too expert-y, so the solution is to rely upon anti-experts (not novices).

    10. AI tools not only streamline the educational content creation process but also ensure that the content is accessible, engaging, and tailored to meet the diverse needs of learners

      The word "ensure" here is preposterous. AI can't assure anything. As long as there's a realistic chance of random hallucination, nothing is certain.

      Trying to admit here that there can always be errors in things that people do. But that kind of error isn't necessarily random, and it can often be anticipated and compensated for.

    11. GenAI can analyze existing instructional documents and recommend layout, design, and visual hierarchy improvements to make them more

      And on what principles or basis is it making these recommendations?

    12. f a professor only has a few key points, GenAI can flesh out initial vague ideas with additional supporting information, examples, and relevant statistics.

      And then the faculty member needs to spend EXTRA time making sure all those things are real… or they don't and who cares.

    13. we can use GenAI to help create drafts of such components as unit introductions, conclusions, and other course content, from which faculty can produce substantive components using their own expertise and professional judgment

      This phrasing just makes me feel dirty. "…from which faculty can produce…using their own expertise and professional judgment."

    14. Instructors can use that content to envision what a course looks like and to provide a jump-start to create their own list of modules and topics to teach

      Here we note the subtle subconscious biases that result based on what we use to jumpstart our creative process.

      And… why should we have AI do this rather than simply look at syllabi from colleagues?

    15. nstructors often work with subject-matter and content knowledge, which can be so expansive and complex that they have blind spots in the course planning process, or a lack of understanding of student or curriculum needs. This gap between content mastery and pedagogical need can overwhelm faculty. In several ways, this course mapping process can become easier with the help of GenAI.

      So, the problem is "experts have too much knowledge" and they don't know how to translate that to novices? And the solution is not to provide better faculty development on pedagogy, but rather to let the AI do it?

    16. Course design typically follows a backward-design method

      Well, when it's done well. When it's done by those without training I'm not sure this is a given.

    17. GenAI can significantly improve the efficiency with which institutions develop content that is closely aligned with the curriculum and course objectives

      I think it's important to note here that the authors talk about "institutions"—this isn't a focus really on making life easier for a particular instructor. It's what helps the institution do things at scale.

  2. Sep 2024
    1. So plowing/bulldozing is OK? Doing it doesn't violate control rules but I guess it has to do with length of contact. Plowing on purpose is probably a violation.

    1. So now I teach students to use AI to ask questions from other perspectives. For example, I have them choose paragraphs from their paper and ask, “What would a skeptical reader ask about the following paragraph?” or “What questions would an expert on X have about this paragraph?”

      She doesn't actually indicate whether the results of those prompts are useful.

    2. That said, AI is not completely incapable of giving feedback on more complex issues. I could get some reasonable feedback if I prompted it to attend to a specific problem, like “This paper struggles with identifying the specific contribution it is making to the conversation, as well as distinguishing between the author’s ideas and the ideas of the sources the paper uses. How would a writing professor give feedback on these issues?”

      Probably not the best time-saver if you have to develop custom prompts for each paper to get more detailed feedback.

    3. But if we can’t trust AI to assess novelty or depth of insight because it can’t actually think, we shouldn’t trust the AI to offer nuanced feedback on structure and grammar, either

      Good point.

    4. leave “structure, language use and grammar” to AI to score while teachers look for “novelty, creativity and depth of insight.”

      I still am not comfortable suggesting that we can even leave this to AI. Just because it can generate proper syntax and readable prose, it doesn't mean it's qualified to EXPLAIN it because it still doesn't understand it.

    5. What I found led me to a very different conclusion than that of the professors cited in the CNN article: While they saw AI as reducing the time it takes to grade effectively by allowing faculty members to focus on higher-level issues with content and ideas, I found using it creates more problems and takes longer if I want my students to get meaningful feedback rather than just an arbitrary number or letter grade

      So… What's the difference? Even though we're loathe to do it, do we need to start talking about judging the quality of teaching? Just as we've started to say that any assignment that an AI can complete is probably not a good assignment—do we need to start saying that any feedback left by an AI is probably not good enough feedback?

    6. it illustrates a core problem with how we’ve conceptualized writing and grading in higher education

      I do want to think further about the role played by writing itself within education.

  3. Aug 2023
    1. The AI could then generate quizzes to assess the learner's understanding of each lesson

      So much presumption going on here. It COULD, presuming that what it's doing is good enough to meet our standards for how it should be done by a human, presuming that an LLM can even really "do" this.

    2. The quizzes could be automatically graded, and scores and feedback would be provided instantly

      This is so NOT the kind of feedback that's really useful compared to REAL feedback.

    3. Not only does this immediate feedback contribute to the student's learning, it also allows the instructor to reallocate some of the time that would have been spent manually grading and providing detailed feedback on essays and other writing assignments to instruction.

      Oh. My. Goodness. Providing feedback isn't important, but "instruction" is—meaning lecturing?

    4. A survey of school and college staff in the UK revealed that K–12 teachers spend 31 percent of their time planning lessons, grading tests, and doing administrative work, and just 43 percent of their time teaching.

      Don't even get me started on what counts as "teaching."

    5. AI-powered learning analytics tools can help instructors track learners' progress, identify areas of improvement, and automatically adjust the course material.

      Isn't this a rehash of #6?

    6. If a student is struggling with punctuation and sentence structure, for example, the AI might start with modules focusing on these areas.

      I wonder what would happen if we polled actual English composition faculty to see how large a role punctuation and sentence structure really play in their learning objectives…

    7. AI can automatically grade assignments, such as essays or responses to multiple-choice questions

      It's appalling how thee two things are lumped together. It takes no AI to evaluate a multiple choice question, and the claim that it can grade essays is most definitely not shared by many who actually use essay questions.

    8. AI-powered tools can help instructors automatically generate high-quality course content, such as quizzes, assessments, and simulations.

      So many alarms going off.

    9. improved collaborative learning performances

      I don't feel like digging into the article behind this, but I would love to know what this phrase means, how they operationalized it, and how they measured it.

    10. The AI tracks performance as the learner progresses through the lessons. If the learner is doing well, the AI can increase the difficulty of the exercises, keeping the student challenged

      How is this a separate "way AI is transforming ID"? This is just a rehash of #1 and #2 with the buzzword "gamification" attached to it.

    11. The extracted information is then encoded into standardized medical terminology and structured so it is easy to search and analyze.

      I'm struggling to understand how this is really about a learning tool. It just sounds like a description of an NLP-powered health information recording system.

    12. This assessment could involve asking the learner to solve a range of problems that cover different aspects of physics. The ITS analyzes the assessment data to identify knowledge gaps

      This is put into such a different light by the alternative grading literature that really questions how we go from ranking scores on things to what that means about knowing if a student has mastered certain learning objectives.

    13. build new experiential pathways

      I have a hard time understanding how AI would do this by itself, unless they're using "new pathways" in a far more limited sense that I would imagine they are.

    14. The platform uses assessment data to tailor the course content to fit the student's needs.

      To be clear, though, it could only work within the created content. And it couldn't actually work with the student to help better understand factors that might be affecting the student's performance.

    15. further promoting engagement

      Will a learner really value an AI-generated "good job" as much as it would coming from an instructor who had put time into working with them personally?

  4. Jul 2022
    1. This kind of accuracy is supported by our fourth pillar: Students have opportunities to complete reassessments without penalty as they engage in a feedback loop. The “without penalty” part is essential, because it ensures that only a student’s eventual level of understanding, not their initial attempts, is represented in their grade.

      This is a good description—the emphasis on eventual understanding. There's no reason that initial attempts should be relevant or limiting.

  5. Jan 2022
    1. A school that prides itself on providing an intimate classroom experience for its students might well wish to use the platforms that are designed specifically to mimic the small, in-person, and synchronous classroom

      I'm not sure I know what those platforms are.

    2. We need to expand beyond the primarily self-paced and asynchronous approach we have already tried.

      At GVSU, we emphasize that self-paced and asynchronous are NOT the same thing. Are we unique in that?

  6. Oct 2021
    1. Make the first week more about basic principles to the constitution and courts

      Are you saying that you want that sooner? Right now we have that in week 2 and 3…

    2. checklist for each week's course work

      So… I have some programming skills, and I've actually built something like this. I'll try to add it to our site in the next few weeks.

    3. better alternative to a substitute for class discussioncthat the hypothesis annotation

      We'll have plenty of Flipgrids. I tend to use hypothesis only for particular kinds of discussions.

    4. I would like a solid list of things in one place. I feel like I have to search for things and I always feel like I am missing out

      I think you might have made a comment on this up above? My only question is: are we talking a list for what happens in a week, or over the semester?

    5. many are commenting or making a video on Friday/Saturday

      I'm considering turning some discussions into multi-week discussions… Maybe that will help?

    6. provoke earlier responses to flipgrid, annotations, etc. so that way there could be engagement after an initial comment or answer

      I and many faculty would love to know how to make this happen. I could add additional "due dates" for posting earlier in the week, but the downside is that doesn't work for everyone and it turns into a recordkeeping headache.

    7. I think going over some legal terminology could be helpful.

      For many semester I had a required "learn legal terminology" component, but I removed it this semester to simplify things. This makes me think I need to find a way to reintroduce it.

    8. I didn't know what certain things were, such as the Free Exercise Clause

      In terms of this, I think I need to do a better job of "forcing" students to take a look at the Constitution. I had a link to an online copy, but I didn't instruct you to do anything with it.

    9. but I thought I would be 100% honest about my experience so that first week could be easier on folks in the future

      Thank you for sharing. I appreciate the honesty.

    10. sending the students an email two or three weeks prior to the class beginning, explaining that there will be a new, innovative grading system being used that will take a bit of time to understand

      A good idea. I could include this in the welcome letter and get that sent out earlier.

    11. that I couldn't get an A in the class if I said I was shooting for a B in my Learning Blueprint, so that could be stated more clearly

      Definitely not my goal! You can always get a higher grade. This was just a way to get students to look at the requirements and to think realistically about their semester.

    12. I very much appreciated the grading system as soon as I understood it, and it's exciting to me to be able to possibly use something like it in a class I teach myself.

      👍🏻

    13. would be a zoom or skype call once a week with the whole class

      Note that you're not the only one to suggest this. I'm not opposed to the idea, but I do wonder how many would participate.

    14. I would suggest just eliminating a couple of the additonal readings or videos to make the time a little more reasonable for full time students

      I do try to keep everything within the boundaries of the time commitment that a 3 credit course is supposed to have. I could, though, designate a few things here or there as "optional."

    15. basically when you explain and interpret the meaning of things/ break it down

      This is what a good lecture/video should do. I'll try to make sure you have more of them.

    16. work to come later in the semester based on the comments in the Flipgrid videos from past students

      Yeah… Don't put off everything until the end. But do note that there are a couple of weeks at the end of the semester where there aren't modules to complete.

    17. get a similar learning experience roughly as if we had in-person lectures

      Hmmmm… I'm not sure that in-person lectures are always worth recreating…

    18. you're missing certain aspects from face-to-face discussions that are important

      So one of the reasons that I started the annotation assignments is because online it's hard to do something that's pretty easy to do in the classroom: to have a conversation around a specific text. That's hard to do on a discussion board, and it's hard to do in a Flipgrid. Rest assured that I don't plan to use hypothesis for most of our discussions.

    19. benefit from having real discussions with each other

      So… I'm not opposed to this idea. Here's the challenge though: if it's not required, my sense is that turnout won't be very high. Which means that "real discussions" aren't really going to happen. This is one reason that I moved away from having formal scheduled office hours. No one ever came. But I'm willing to be convinced other wise.

    20. In my other classes, I had hardly any interaction with others - apart from discussion posts - and that was incredibly isolating.

      I can imagine. Courses shouldn't be like that.

    21. the extra effort put into lectures such as the images and animation

      A lot of those videos I've had for a while. I need to make some more—but they do indeed take some extra effort…

    22. PLS 206 is much more structured and easier to follow than my previous courses. I don't feel like I might miss something because I didn't look at the right tab or whatever.

      Thank you much. Comments like this always confuse me a bit when you put them next to other comments (see somewhere up the page) about things not being well-organized. Would love to know what everyone uses to make that judgement!

    23. That has not turned out to be the case, fortunately, but this is the first asynchronous class I've taken that has somehow made me forget that it's asynchronous

      I take that as a really high compliment.

    24. the amount of coursework we are expected to teach ourselves is overwhelming too

      Two thoughts. 1) there is indeed a lot of work in this course. I try not to hide that fact. 2) What do you see as the difference between teaching "yourselves" and the alternative—especially in an online class?

    25. Invasive, class is no longer specific day(s). It lasts all week and I feel like I'm in school 7 days a week. This can get a bit overwhelming.

      Interesting. Have your other online classes been different? Or are you talking about the other classes?

    26. All of the other classes were a lot of reading and learning on your own. This class is more interactive and has videos to get a better understanding

      Interesting, interesting. I wonder what you mean by "learning on your own"—there are students who would argue that what they do in most online classes amounts fo "learning on you own." I've got my own theory about that, but maybe I'll share that later…

    27. my previous online class experience could be summed up as simply as doing reading/watching and discussion boards

      Yeah… a lot of faculty do that. We try to convince them that's not the best idea.

    28. One of my past professors never posted his own lectures or videos so I never saw what he looked like. I felt like the computer was my teacher

      In terms of my day job helping faculty become better at teaching online—this is exactly what we try to get them to stop doing.

    29. more than text annotations

      I throw those in for variety and when it makes more sense to do an activity that way—such as talking about specific texts.

    30. There's no fix for this, unfortunately; I just have to take the extra time into account when planning out my work

      I don't think "sorry" is the right thing to say, but…

    31. Also, the due dates for this weeks folder is different when it's in the content module folder vs. when you click on it and that was a little stressful as well

      Hmmmmm. My mistake, sorry.

    32. comprehensive list of every thing that I need to do

      Are you thinking in terms of what you need to do each week, or what you need to do over the semester? In terms of the former, there is the list in the instructions—and I'm exploring ways to help make that clearer. In terms of things over the semester, there is both a checklist and a list of things required for each final grade. Is there a way that you would want the information organized differently?

    33. All of the folders can be confusing

      Is there any particular folders that you don't think are necessary or could be eliminated? How would you organize things? I'm actually using an organization system this semester that has fewer "top" folders and more in the middle…

    34. things can be very wordy

      Is there anything in particular that you think is wordy? Descriptions, instructions, etc? My policy is usually that more words are better.

    35. average time to give to this class reaches the seven hour mark

      I understand entirely. Note, though, that seven hours is exactly within the time range that you're supposed to be devoting to a 3 credit course.

    36. History of Democracy class

      LOL. I would suggest dropping History of Democracy to focus more on our class—but that sounds like a really important and interesting course.

    37. Not being able to see what I completed in the modules after I did them

      I'm not sure I understand what you're commenting on here. Things that you've done should still be visible to you.

    38. Not being able to have a regular lecture where I'm F2F with the instructure and classmates. I think I learn better this way. 

      Online courses aren't necessarily for everyone, for a variety of reason.

    39. I find those very overwhelming

      Out of curiosity, are they overwhelming because of something about what you're being asked to do (annotate) or is it the difficulty of the material you're commenting on?

    40. I would say the reading from the chapters is the hardest part of this course for me

      I understand that. How this house is designed is a challenge. In part I wish there was a better textbook to use.

    41. I think this really helps me know if I am understanding the information or not.

      It doesn't cover absolutely everything (who would want to take a quiz that long?) but that's the idea!

  7. Jul 2021
    1. Give students frequent low-stakes quizzes, including quizzes during the online class sessions, to reduce the temptation to cheat

      Good for in-person courses too.

    2. Also, in an online environment it is difficult to ensure that all students have an equal opportunity to speak or ask questions and, as a result, there can be a perception (or reality) that some students dominate discussions.

      What? Isn't one of the biggest selling points for online discussions (historically speaking) that more people engage and that those who lurk usually participate more?

    3. They remain passive during class; experience high levels of stress, anxiety and depression

      Is this about online classes, or about learning during the pandemic?

    4. In part, that’s because it harder to check on whether students have grasped the material

      No—we just "presume" that students get it when we ask them face-to-face.

    5. But let’s not forget the importance of social and emotional learning; of promoting relationship skills, social, emotional and self-awareness, a growth mind-set, and a sense of self-efficacy.

      I can't tell from how he's writing (and the point of the post) if he's saying this is only for online teaching, or for all teaching.

    6. Relying primarily on high-stakes exams or term papers is a recipe for disaster, which will only encourage academic dishonesty

      Why is this not recognized as being an issue for "offline" classes?

    7. Then there’s the pedagogical challenge: making sure that students have multiple ways to grasp the material.

      Why is this any different than for a normal class?

  8. May 2021
    1. In the end, my dad chose to prioritize balance.He made active choices to be present for his family and to sacrifice some of the status and monetary rewards that a “big” academic career can bring

      I think there's another question lurking here. We're presuming that Kim's dad found that the balance he chose (less emphasis on career) lead to satisfaction. Why do more people today not find that particular ratio satisfying?

  9. Apr 2021
    1. What do students need to learn from this project? What are the most important things they need feedback on right now? We can ask these questions with an eye toward future projects and go into grading sessions with a plan.

      Good reminders

    1. Nowadays, professors and high-level staff spend enormous amounts of time and energy doing the logistical work that administrative support professionals once did.

      I'm curious what Kim has in mind here.

    1. Before we get there, however, there’s one other issue to address: how much has to go in the head, and how much can be in the world? 

      Reminds me of Maria Anderson's new ESIL learning objective scale.

  10. Mar 2021
    1. (Acton, 2017; Fenwick, Edwards, & Sawchuk, 2011; Gourlay & Oliver, 2018; Gourlay, 2020; Hamilton & Friesen, 2013; Leander & Boldt, 2012). (Adams & Thompson, 2016),

      find

    2. This raises the question about where exactly the university is located under lockdown

      So I'm reading this and thinking about the idea of "where does learning happen" for students, which then leads to "where is the learning community for a course." The next step out seems to be to talk about the institution.

    3. What is striking about these accounts is the extent to which these digital practices were messy assemblages of human and nonhuman actors, unfolding in the nitty-gritty material and spatial circumstances of the homes in which the academics were locked down

      Is this a new kind of space, both private and public at the same time?

  11. Jul 2020
    1. The notion that students – especially new students – overwhelmingly want F2F instruction in Fall 2020, might not be as real as we think

      Agreed.

    2. well-designed, required 1-credit online course for all Fall students to take — maybe an intro to their discipline, or a "how to learn" course based on Make It Stick,

      An excellent idea.

    1. he elec-tors, the Court noted, were chosen “simply to register the will of the appointing power in respect of a particular can-didate.”

      Still, "how things have developed in practice" is not the same as "how things should function."

  12. Jun 2020
    1. I will provide a document with six bad maps (one with modeled critique) and five other bad maps that they will fill critique on the discussion board

      Is this the bad/good map activity, or is this different?

    2. I will also create a unique Blackboard Collaborate Ultra room for each group to use as a tool for discussion, if they choose

      So the discussion post needs to be kind of "final", like a presentation, and the Collaborate room is to let them work together on it?

    1. Students will prepareand turn in3-5 minute presentations regarding one of the five key issues

      Is this something they've been working on throughout the semester? Monday seems early if it's just assigned that week. Presentation is also a term that tends to get used for "big" projects.

    2. I struggle with this part of course planningbecauseI believe the learning objectives for many of the courses I teach areconfusing,too numerous, too vague and not discrete.

      not uncommon. SOR objectives can be very poor.

    1. What troubles Raymond about many conversations about the fall, he says, is what he describes as "this immediate reflex, knee-jerk reaction that we have to replicate what has been standard experience in the physical classroom.

      Agreed.

    1. In class, students will participate in an interactive (in class) lecture-discussion preceding the distribution of the primary document

      Is this an activity or an assessment?

    1. wewill have a synchronous session for the first two days of class to cover the three sections under consideration (on the geometry of rectangular 3-D space and vectors). These sessions will be delivered and recordedvia BbCollaborate

      Does this need to be synchronous?