Just out of curiosity. I have no moral stance on it, if a tool works for you I’m definitely not judging anyone for using it. Do whatever you can to get your work done!
High school history teacher here. It’s changed how I do assessments. I’ve used it to rewrite all of the multiple choice/short answer assessments that I do. Being able to quickly create different versions of an assessment has helped me limit instances of cheating, but also to quickly create modified versions for students who require that (due to IEPs or whatever).
The cool thing that I’ve been using it for is to create different types of assessments that I simply didn’t have the time or resources to create myself. For instance, I’ll have it generate a writing passage making a historical argument, but I’ll have AI make the argument inaccurate or incorrectly use evidence, etc. The students have to refute, support, or modify the passage.
Due to the risk of inaccuracies and hallucination I always 100% verify any AI generated piece that I use in class. But it’s been a game changer for me in education.
I should also add that I fully inform students and administrators that I’m using AI. Whenever I use an assessment that is created with AI I indicate with a little “Created with ChatGPT” tag. As a history teacher I’m a big believer in citing sources :)
How has this been received?
I imagine that pretty soon using ChatGPT is going to be looked down upon like using Wikipedia as a source
I would never accept a student’s use of Wikipedia as a source. However, it’s a great place to go initially to get to grips with a topic quickly. Then you can start to dig into different primary and secondary sources.
Chat GPT is the same. I would never use the content it makes without verifying that content first.
Is it not already? I’ve found it to be far less reliable than Wikipedia.
This is why I read through everything I use to make sure it’s accurate.
Well the people that use it know that, but for the average person, chatgpt still has a high reputation
Is it fair to give different students different wordings of the same questions? If one wording is more confusing than another could it impact their grade?
I had professors do different wordings for questions throughout college, I never encountered a professor or TA that wouldn’t clarify if asked, and, generally, the amount of confusing questions evened out across all of the versions, especially over a semester. They usually aren’t doing it to trick students, they just want to make it harder for one student to look at someone else’s test.
There is a risk of it negatively impacting students, but encouraging students to ask for clarification helps a ton.
My professors would randomize the order of the questions instead.
I have had professors that essentially create chiral A & B versions and also randomize the order. Never underestimate the amount of effort a lazy student will go through to cheat.
I use ChatGPT to create banks of questions that are aligned to the essential topics that I need students to learn. Then I randomly assign the same number of questions to each student from each essential topic. I give the students the list of topics to focus their studying on.
I also have other “categories” that form their final grade, things like participation and homework assignments. So any marginal unfairness that might result from randomized test questions is more that made up for over the course of everything I grade them on.
Sure it could but the same issue is present with one question. Some students will get the wording or find it easy others may not. Having a test in groups to limit cheating is very common and never led to any problems as far as my anecdotal evidence goes.
You’re increasingly the odds by changing the wording. I don’t see why it’s necessary. Just randomize the order of the questions would suffice.
I’m a special education teacher and today I was tasked with writing a baseline assessment for the use of an iPad. Was expecting it to take all day. I tried starting with ChatGPT and it spat out a pretty good one. I added to it and edited it to make it more appropriate for our students, and put it in our standard format, and now I’m done, about an hour after I started.
I did lose 10 minutes to walking round the deserted college (most teachers are gone for the holidays) trying to find someone to share my joy with.
I wish I had that much opportunity to write (or fabricate) my own teaching material. I’m in a standardized testing hellscape where almost every month there’s yet another standardized test or preparation for one.
It’s one of the fascinating paradoxes of education that the more you teach to standardized tests, the worse test results tend to be. Improved test scores are a byproduct of strong teaching - they shouldn’t be the only focus.
Teaching is every bit as much an art as it is a science and straight-jacketing teachers with canned curricula only results in worse test scores and a deteriorated school experience for students. I don’t understand how there are admins out there that still operate like this. The failures of No Child Left Behind mean we’ve known this for at least a decade.
Removed by mod
I don’t have any bosses, but as a consultant, I use it a lot. Still gotta charge for the years of experience it takes to understand the output and tweak things, not the hours it takes to do the work.
Basically this. Knowing the right questions and context to get an output and then translating that into actionable code in a production environment is what I’m being paid to do. Whether copilot or GPT helps reach a conclusion or not doesn’t matter. I’m paid for results.
A junior team member sent me an AI-generated sick note a few weeks ago. It was many, many neat and equally-sized paragraphs of badly written excuses. I would have accepted “I can’t come in to work today because I feel unwell” but now I can’t take this person quite so seriously any more.
Classic over explaining to cover up a lie.
I never send anything other than “I’ll be out of the office today” for every PTO notice.
Exactly and lets me honest you coworkers don’t want to heard about you explosive diarrhea problems or the weird mole on your butt.
Ask yourself why they felt the need to generate an AI sick note instead of being honest 👌
I dunno, I’d consider it a moral failing on the part of the person who couldn’t be honest and direct, even if there’s a cultural issue in the workplace.
Dunno, everyone else seems to be happy sending a one-liner 👌
Exactly, if they’re too lazy to write a fake sick note then they’re certainly too lazy to work, either send them in for remediation or terminate them, either way they shouldn’t be in the workplace
I had a coworker come to me with an “issue” he learned about. It was wrong and it wasn’t really an issue and the it came out that he got it from ChatGPT and didn’t really know what he was talking about, nor could he cite an actual source.
I’ve also played around with it and it’s given me straight up wrong answers. I don’t think it’s really worth it.
It’s just predictive text, it’s not really AI.
I concur. ChatGPT is, in fact, not an AI; rather, it operates as a predictive text tool. This is the reason behind the numerous errors it tends to generate and its lack of self-review prior to generating responses is clearest indication of it not being an AI. You can identify instances where CHATGPT provides incorrect information, you correct it, and within 5 seconds of asking again, it repeat the same inaccurate information in its response.
It’s definitely not artificial general intelligence, but it’s for sure AI.
None of the criteria you mentioned are needed for it be labeled as AI. Definition from Oxford Libraries:
the theory and development of computer systems able to perform tasks normally requiring human intelligence, such as visual perception, speech recognition, decision-making, and translation between languages.
It definitely fits in this category. It is being used in ways that previously, customer support or a domain expert was needed to talk to. Yes, it makes mistakes, but so do humans. And even if talking to a human would still be better, it’s still a useful AI tool, even if it’s not flawless yet.
It just seems to me that by this definition, the moment we figure out how to do something with a computer, it ceases to be AI because it no longer requires human intelligence to accomplish.
I guess the word “normally” takes care of that. It implies a situation outside of the program in question.
i think learning where it can actually help is a bit of an art - it’s just predictive text, but it’s very good predictive text - if you know what you need and get good and giving it the right input it can save a huge about of time. you’re right though, it doesn’t offer much if you don’t already know what you need.
Can you hand me an example? I keep hearing this but every time somebody presents something, be it work related or not, it feels like at best it would serve as better lorem ipsum
I’ve had good success using it to write Python scripts for me. They’re simple enough I would be able to write them myself, but it would take a lot of time searching and reading StackOverflow/library docs/etc since I’m an amateur and not a pro. GPT lets me spend more time actually doing the things I need the scripts for.
A use it with web development by describing what I want something to look like and have it generate a React component based on my description.
Is what it gives me the final product? Sometimes, but it’s such a help to knock out a bunch of boilerplate and get me close to what I want.
Also generating documentation is nice. I wanted to fill out some internal wiki articles to help people new to the industry have something to reference. Spent maybe an hour having a conversation asking all of the questions I normally run into. Cleaned up the GPT text, checked for inaccuracies, and cranked out a ton of resources. That would have taken me days, if not weeks.
At the end of the day, GPT is better with words than I am, but it doesn’t have the years of experience I have.
More often than not you need to be very specific and have some knowledge on the stuff you ask it.
However, you can guide it to give you exactly what you want. I feel like knowing how to interact with GPT it’s becoming similar as being good at googling stuff.
I’ve played around with it for personal amusement, but the output is straight up garbage for my purposes. I’d never use it for work. Anyone entering proprietary company information into it should get a verbal shakedown by their company’s information security officer, because anything you input automatically joins their training database, and you’re exposing your company to liability when, not if, OpenAI suffers another data breach.
The very act of sharing company information with it can land you and the company in hot water in certain industries. Regardless if OpenAI is broken into.
Run llama locally: https://github.com/cocktailpeanut/dalai
I’ve been using it a little to automate really stupid simple programming tasks. I’ve found it’s really bad at producing feasible code for anything beyond the grasp of a first-year CS student, but there’s an awful lot of dumb code that needs to be written and it’s certainly easier than doing it by hand.
As long as you’re very precise about what you want, you don’t expect too much, and you check its work, it’s a pretty useful tool.
I’ve found it useful for basically finding the example code for a 3rd party library. Basically a version of Stack Exchange that can be better or worse.
I essentially use it as interactive docs. As long as what you’re learning existed before 2021 it’s great.
Yeah sadly the times I’ve gotten screwed is when a major version change occurred in 2022. Got burned once doing that and now I know to check to see if we have upgraded past the version the code works before spending too much time working on it.
I don’t know you, the language you use, nor the way you use chat gpt, but I’m a bit surprised at what you say. I’ve been using chatgpt on a nearly daily basis for months now and while it’s not perfect, if the task isn’t super complicated and if it’s described well, after a couple of back and forth I usually have what I need. It works, does what is expected, without being an horrendous way to code it.
And gpt4 is even better
My job involves a lot of shimming code in between systems that are archaic, in-house, or very specific to my industry (usually some combination of the three), so the problems I’m usually solving don’t have much representation in gpt’s training data. Sometimes I get to do more rapid prototyping/sandbox kind of work, and it’s definitely much more effective there where I’m (a) using technologies that might pop up on stack overflow and (b) don’t have a set of arcane constraints the length of my arm to contend with.
I’m absolutely certain that it’s going to be a core part of my workflow in the future, either when the tech improves or I switch jobs, but for right now the most value I get out of it is as effectively a SO search tool.
Got it. With context, it makes much more sense.
I myself use some of the most widely used programming language ( php and react mostly ) so yhea, there’s plenty to be found with those
I, like most peaple, find it easier to write code than to read it. That “check its work” step means more work actually, for me
not chatGPT - but I tried using copilot for a month or two to speed up my work (backend engineer). Wound up unsubscribing and removing the plugin after not too long, because I found it had the opposite effect.
Basically instead of speeding my coding up, it slowed it down, because instead of my thought process being
- Think about the requirements
- Work out how best to achieve those requirements within the code I’m working on
- Write the code
It would be
- Think about the requirements
- Work out how best to achieve those requirements within the code I’m working on
- Start writing the code and wait for the auto complete
- Read the auto complete and decide if it does exactly what I want
- Do one of the following depending on 4 5a. Use the autocomplete as-is 5b. Use the autocomplete then modify to fix a few issues or account for a requirement it missed 5c. Ignore the autocomplete and write the code yourself
idk about you, but the first set of steps just seems like a whole lot less hassle then the second set of steps, especially since for anything that involved any business logic or internal libraries, I found myself using 5c far more often than the other two. And as a bonus, I actually fully understand all the code committed under my username, on account of actually having wrote it.
I will say though in the interest of fairness, there were a few instances where I was blown away with copilot’s ability to figure out what I was trying to do and give a solution for it. Most of these times were when I was writing semi-complex DB queries (via Django’s ORM), so if you’re just writing a dead simple CRUD API without much complex business logic, you may find value in it, but for the most part, I found that it just increased cognitive overhead and time spent on my tickets
EDIT: I did use chatGPT for my peer reviews this year though and thought it worked really well for that sort of thing. I just put in what I liked about my coworkers and where I thought they could improve in simple english and it spat out very professional peer reviews in the format expected by the review form
Those different sets of steps basically boil down to a student finding all the ways they can to cheat and spending hours doing it, when they could have just used less time to study for the test.
Not saying that you’re cheating, just that it’s the same idea. Usually the quickest solution is to just tackle the thing head-on rather than find the lazy workaround.
What I think ChatGPT is great for in programming is ‘I know what I want to do but can’t quite remember the syntax for how to do it’. In those scenarios it’s so much faster than wading through the endless blogspam and SEO guff that search engines deal in now, and it’s got much less of a superiority complex than some of the denizens of SO too.
As a side note, whilst I don’t really use AI to help with coding, I was kinda expecting what you describe, more so for having stuff like ChatGPT doing whole modules.
You see, I’ve worked as a freelancer (contractor) most of my career now and in practice that does mostly mean coming in and fixing/upgrading somebody else’s codebase, though I’ve also done some so-called “greenfield projects” (entirelly new work) and in my experience the “understanding somebody else’s code” is a lot more cognitivelly heavy that “coming up with your own stuff” - in fact some of my projects would’ve probably gone faster if we just rewrote the whole thing (but that wasn’t my call to make and often the business side doesn’t want to risk it).
I’m curious if multiple different pieces of code done with AI actually have the same coding style (at multiple levels, so also software design approach) or not.
A lot of people are going to get fucked if they are…
It’s using the “startup method” where they gave away a good service for free, but they already cut back on resources when it got popular. So what you read about it being able to do six months ago, it can’t do today.
Eventually they’ll introduce a paid version that might be able to do what the free one did.
But if you’re just blindly trusting it, you might have months of low quality work and haven’t noticed.
Like the lawyers recently finding out it would just make up caselaw and reference cases. We’re going to see that happen more and more as resources are cut back.
Huh? They already introduced the paid version half a year ago, and that was the one being responsible for the buzz all along. The free version was mediocre to begin with and has not gotten better.
When people complain that ChatGPT doesn’t comply to their expectations it’s usually a confusion between these two.
Like the lawyers recently finding out it would just make up caselaw and reference cases. We’re going to see that happen more and more as resources are cut back.
It’s been notorious for doing that from the very beginning though
Anyone blindly trusting it is a grade A moron, and would’ve just found another way to fuck up whatever they were working on if ChatGPT didn’t exist.
ChatGPT is a tool, if someone doesn’t know what they’re doing with it then they are gonna break stuff, not ChatGPT.
This is exactly like people who defend Tesla by saying it’s your fault if you believed their claims about what a Tesla can do…
Which isn’t a surprise, there’s a huge overlap between being gullible to believe either companies claims, and some people will vend over backwards to defend thos companies because of sink cost fallacy
I don’t know what OpenAI even claims that ChatGPT can do, but if you trust marketing from any company then you’re gonna get burnt.
I’m not defending the company in any way, more just defending that in general LLMs can be useful tools, but people need to make educated decisions and take a bit of responsibility.
That may have been their plan, but Meta fucked them from behind and released LLama which now runs on local machines, up to 30B parameter size and by end of the year will run at better than GPt3.5 ability on an iphone.
Local llms, like airoboros, WizardLm, Stable Vicuña or Stable Coder are real alternatives in many domains.
Some of my co-workers use it, and it’s fairly obvious, usually because they are putting out even more inaccurate info than normal.
Urgh one of my coworkers (technically client, but work closely alongside) clearly uses it for every single email he sends, and it’s nauseating. He’s crass and very poorly spoken in person, yet overnight all his email correspondence is suddenly robotic and unnecessarily flowery. I use it regularly myself, for fast building of Excel formulas and so forth, but please, don’t dump every email into it.
I use it to write performance reviews because in reality HR has already decided the results before the evaluations.
I’m not wasting my valuable time writing text that is then ignored. If you want a promotion, get a new job.
To be clear: I don’t support this but it’s the reality I live in.
This is exactly what I use it for. I have to write a lot of justifications for stuff like taking training, buying equipment, going on business travel, etc. - text that will never be seriously read by anyone and is just a check-the-box exercise. The quality and content of the writing is unimportant as long as it contains a few buzz-phrases.
Just chiming in as another person who does this, it’s absolutely perfect. I just copy and paste the company bs competencies, add in a few bs thoughts of my own, and tell it to churn out a full review reinforcing how they comply with the listed competencies.
It’s perfect, just the kinda bs HR is looking for, I get compliments all the time for them rofl.
Work smarter, not harder, lol.
Can you please elaborate on your experience of HR people deciding the results before the evaluation? Just curious
Sure!
It happens behind closed doors and never in writing to keep up the farce, but usually I’m given a paltry number of slots of people I can label as high performers. This is really a damn shame because most of my team members are great employees. This is used as a carrot to show that we do give raises and promotions after all, but the proportion is so small it’s effectively zero. I’m very clear to my team that trying to becoming a top performer to get a promotion is a bad investment. I do my best to communicate the futility without actually saying it literally in such a way that it could get me into trouble.
Next, they use a spreadsheet to figure who they can probably underpay based on a heuristic likelihood that person would actually leave vs current market rates. These automatically become the low performers ahem satisfactory. You’re penalized for being here longer or specializing in something with a small market. Everyone else falls somewhere between satisfactory and above average which makes little difference.
The performance reviews are merely weak documentation to show that somehow HR was “justified” by selectively highlighting strengths or weaknesses depending on the a priori decision of what your performance level was to be.
It’s a huge tautology with only one meaningful conclusion: you will be underpaid, and it gets worse over time.
Thanks. This is great insight and tracks with some personal experience or experience of friends.
You could make a whole post about this topic, but I was curious what’s your advice to an employee that wants to do good work, but who doesn’t want to be taken advantage of?
The truth is you have to do good work for yourself because you care about the quality of your work. You work for you.
You separate the factors. You do good work for you because you care because a life doing things you don’t care about is less meaningful.
Separately you look at pay. You leave when it’s no longer worth staying, which for most people is about every two to three years at least for your early career.
deleted by creator
Why should anyone care? I don’t go around telling people every time I use stack overflow. Gotta keep in mind gpt makes shit up half the time so I of course test and cross reference everything but it’s great for narrowing your search space.
The problem with using it is that you might be sending company proprietary or sensitive information to a third party that’s going to mine that information and potentially expose that information, either directly or by being hacked. For example, this whole thing with Samsung data: https://techcrunch.com/2023/05/02/samsung-bans-use-of-generative-ai-tools-like-chatgpt-after-april-internal-data-leak/
We’ve been instructed to use ChatGPT generically. Meaning, you ask it generic questions that have generic usage, like setting up a route in Express. Even if there is something more specific to my company, it almost always can be transformed into something more generic, like “I have a SQL DB with users in it, some users may have the ‘age’ field, I want to find users that have their age above 30” where age is actually something completely different (but still a number).
Just need to work carefully on ChatGPT.
I’ve done so on rare occasion, but every time it made stuff up. Wanted terraform examples for specific things… and it completely invented resource types that don’t exist.
Based on the code I’ve seen from our devs, it must be getting worse. It’s never produced acceptable quality imo, but the examples I’ve seen lately are laughably bad.
It’s definitely gotten weirder lately, I think they keep training it on data and they’re not looking into that data enough. That’s the thing about AI though, it has to come up with an answer. You gave it a prompt. It will come up that answer even if it’s not a good one
It’s not a search engine or encyclopedia. If you want facts, you have to use the tools for facts.
Love your username!
Soul skaters 4 lyfe!
Not sure how it could help me solder or find faults on PCBs.
Make bing ai analyze the picture
Pretty sure I’ve RMA’d a few pieces of hardware where they did just that
Only used it a couple of times for work when researching some broad topics like data governance concepts.
It’s a good tool for learning because you can ask it about a subject and then ask it to explain the subject “as a metaphor to improve comprehension” and it does a pretty good job. Just make sure you use some outside resources to ensure you’e not being hallucinated all over.
My bosses use it to write their emails (ESL).
ESL is actually a great use, although there’s a risk someone might not catch a hallucination/weird tone issue. Still it would be really helpful there.
Best used in tandem with something like languagetool.org for the final revision.
yeah my biggest use case it quick summaries of things. it’s great getting a few bullet points, and i miss details a lot less.
Removed by mod
When I’m pissed off I use it to make my emails sound friendly.
