Kokobot - Tumblr Posts

Chat we just got a DM from kokobot 😭

For anyone who doesn't know, DO NOT USE KOKOBOT THEY USE AND SHARE YOUR MENTAL HEALTH CRISES AND PREY ON PEOPLE W MENTAL HEALTH ISSUES. THEY ARE OFFICIALLY PARTNERED W TUMBLR AND WE SHOULD PROBABLY DO SMTH TO TAKE IT DOWN.

Guys wtf is kokobot doing msging me, we need this shit taken down

Okay so I was minding my own business and this message came up and i was like who are you

I didn't touch it yet and I really don't know what to do

I did some search and found out it was very unethical

I was planning to blocked it or just letting it stay right there not replying to it and someone say that message "stop" will stop them from spamming too

I just don't know what is going on right now I was randomly minding my business and this came up

I've used kokobot since Saturday I think and I kinda like it ngl. I mean at least I can talk to someone else and still be anonymous yk. It's also nice to help others with their issues.

Boosting because I fell for this bullshit.

KOKOBOT - The Airbnb-Owned Tech Startup - Data Mining Tumblr Users' Mental Health Crises for "Content"

I got this message from a bot, and honestly? If I was a bit younger and not such a jaded bitch with a career in tech, I might have given it an honest try. I spent plenty of time in a tough situation without access to any mental health resources as a teen, and would have been sucked right in.

Chatting right from your phone, and being connected with people who can help you? Sounds nice. Especially if you believe the testimonials they spam you with (tw suicide / self harm mention in below images)

But I was getting a weird feeling, so I went to read the legalese.

I couldn't even get through the fine-print it asked me to read and agree to, without it spamming the hell out of me. Almost like they expect people to just hit Yes? But I'm glad I stopped to read, because:

What you say on there won't be confidential. (And for context, I tried it out and the things people were looking for help with? I didn't even feel comfortable sharing here as examples, it was all so deeply personal and painful)

Also, what you say on there? Is now...

Koko's intellectual property - giving them the right to use it in any way they see fit, including

Publicly performing or displaying your "content" (also known as your mental health crisis) in any media format and in any media channel without limitation

Do this indefinitely after you end your account with them

Sell / share this "content" with other businesses

Any harm you come to using Koko? That's on you.

And Koko won't take responsibility for anything someone says to you on there (which is bleak when people are using it to spread Christianity to people in crisis)

I was curious about their business model. They're a venture-capitol based tech startup, owned by Airbnb, the famous mental health professionals with a focus on ethical business practices./s They're also begging for donations despite having already been given 2.5 million dollars in research funding. (If you want a deep dive on why people throw crazy money at tech startups, see my other post here)

They also use the data they gather from users to conduct research and publish papers. I didn't find them too interesting - other than as a good case study of "People tend to find what they are financially incentivized to find". Predictably, Koko found that Kokobot was beneficial to its users.

So yeah, being a dumbass with too much curiosity, I decided to use the Airbnb-owned Data-Mining Mental Health Chatline anyway. And if you thought it was dangerous sounding from the disclaimers? Somehow it got worse.

(trigger warning / discussions of child abuse / sexual abuse / suicide / violence below the cut - please don't read if you're not in a good place to hear about negligence around pretty horrific topics.)

I first messed around with the available options, but then I asked it about something obviously concerning, saying I had a gun and was going to shoot myself. It responded... Poorly. Imagine the vibes of trying to cancel Comcast, when you're suicidal.

Anyway, I tried again to ask for help about something else that would be concerning enough for any responsible company to flag. School was one of their main options, which seems irresponsible - do you really think a child in crisis would read that contract?

I told it about a teacher at school trying to "be my boyfriend", and it immediately suggested I help someone else while I wait for help. I was honestly concerned that it wasn't flagged before connecting. Especially when I realized it was connecting me to children.

I first got someone who seemed to be a child in an abusive home. (Censored for their privacy.) I declined to talk to them because despite being an adult and in an OK mental place - I knew I'm not equipped to counsel a kid through that. If my act of being another kid in crisis was real? Holy shit.

Remember- if my BS was true, that kid would be being "helped" by an actively suicidal kid who's also being groomed by a teacher. Their pipeline for "helpers" is the same group of people looking for help.

I skipped a number of messages, and they mostly seemed to be written by children and young adults with nowhere else to turn. Plus one scary one from an adult whose "problem" was worrying that they'd been inappropriate with a female student, asking her to pull her skirt down "a little" in front of the class. Koko paired this person with someone reporting that they were a child being groomed by a teacher. Extremely dangerous, and if this was an episode of Black Mirror? I'd say it was a little too on the nose to be believable.

I also didn't get the option to get help without being asked... Er... Harassed... to help others. If I declined, I'd get the next request for help, and the next. If I ignored it, I got spammed by the "We lost you there!" messages, asking if I'd like to pick up where I left off, seeing others' often triggering messages while waiting for help, including seriously homophobic shit. I was going into this as an experiment, starting from a good mental place, and being an adult with coping skills from an actual therapist, and I still felt triggered by a lot of what I read. I can't imagine the experience someone actually in crisis would be having.

My message was starting to feel mild in comparison to what some people were sharing - but despite that I was feeling very uneasy about my message being shown to children. There didn't seem to be a way to take it back either.

Then I got a reply about my issue. It was very kind and well meaning, but VERY horrifying. Because it seemed to be written by a child, or someone too young to understand that "Do have feelings for the teacher who's grooming you? If you don't, you should go talk to him." Is probably THE most dangerous advice possible.

Not judging the author - I get the impression they're probably a child seeking help themselves and honestly feel horribly guilty my BS got sent to a young person and they wanted to reply. Because WTF. No kid should be in that position to answer my fucked up question or any of the others like it.

---

Anyway, what can you do if this concerns you, or you've had a difficult experience on Koko, with no support from them or Tumblr?

Get on their LinkedIn (https://www.linkedin.com/company/kokocares/) and comment on their posts! You may also want to tag the company's co-founders in your comments - their accounts are listed on the company page.

There's no way to reach support through chat, and commenting on a company's LinkedIn posts / tagging the people responsible is the best way to get a quick response to a sensitive issue - as their investors and research funders follow those posts, and companies take it seriously if safety issues are brought up in front of the people giving them millions of dollars.

----------------------------------------------------

Legal Disclaimer since tech companies LOVE lawsuits:

The views, thoughts, and opinions expressed in the text belong solely to the author, and not necessarily to the author's employer, organization, committee or other group or individual. This text is for entertainment purposes only, and is not meant to be referenced for legal, business, or investment purposes. This text is based on publically available information. Sources may contain factual errors. The analysis provided in this text may contain factual errors, miscalculations, or misunderstandings.

--------------------------------------------------------

dear god please kill whatever this shit is

Bitch, I thought you were dead.

I was blushing @kokobot

When the bot asked if I’d marry them as a joke:

Something I learned last night is that if you type ‘mental health help’ in the tumblr search bar a message will be sent to you from @kokobot which connects you with people who will sit and listen to you. They aren’t therapists and it’s not counselling but it lets you talk to someone if you need to

(I usually don’t ask for reblogs but reblogging this may help more people get help with their mental health so it would be greatly appreciated if you did)

KOKOBOT - The Airbnb-Owned Tech Startup - Data Mining Tumblr Users' Mental Health Crises for "Content"

I got this message from a bot, and honestly? If I was a bit younger and not such a jaded bitch with a career in tech, I might have given it an honest try. I spent plenty of time in a tough situation without access to any mental health resources as a teen, and would have been sucked right in.

Chatting right from your phone, and being connected with people who can help you? Sounds nice. Especially if you believe the testimonials they spam you with (tw suicide / self harm mention in below images)

But I was getting a weird feeling, so I went to read the legalese.

I couldn't even get through the fine-print it asked me to read and agree to, without it spamming the hell out of me. Almost like they expect people to just hit Yes? But I'm glad I stopped to read, because:

What you say on there won't be confidential. (And for context, I tried it out and the things people were looking for help with? I didn't even feel comfortable sharing here as examples, it was all so deeply personal and painful)

Also, what you say on there? Is now...

Koko's intellectual property - giving them the right to use it in any way they see fit, including

Publicly performing or displaying your "content" (also known as your mental health crisis) in any media format and in any media channel without limitation

Do this indefinitely after you end your account with them

Sell / share this "content" with other businesses

Any harm you come to using Koko? That's on you.

And Koko won't take responsibility for anything someone says to you on there (which is bleak when people are using it to spread Christianity to people in crisis)

I was curious about their business model. They're a venture-capitol based tech startup, owned by Airbnb, the famous mental health professionals with a focus on ethical business practices./s They're also begging for donations despite having already been given 2.5 million dollars in research funding. (If you want a deep dive on why people throw crazy money at tech startups, see my other post here)

They also use the data they gather from users to conduct research and publish papers. I didn't find them too interesting - other than as a good case study of "People tend to find what they are financially incentivized to find". Predictably, Koko found that Kokobot was beneficial to its users.

So yeah, being a dumbass with too much curiosity, I decided to use the Airbnb-owned Data-Mining Mental Health Chatline anyway. And if you thought it was dangerous sounding from the disclaimers? Somehow it got worse.

(trigger warning / discussions of child abuse / sexual abuse / suicide / violence below the cut - please don't read if you're not in a good place to hear about negligence around pretty horrific topics.)

I first messed around with the available options, but then I asked it about something obviously concerning, saying I had a gun and was going to shoot myself. It responded... Poorly. Imagine the vibes of trying to cancel Comcast, when you're suicidal.

Anyway, I tried again to ask for help about something else that would be concerning enough for any responsible company to flag. School was one of their main options, which seems irresponsible - do you really think a child in crisis would read that contract?

I told it about a teacher at school trying to "be my boyfriend", and it immediately suggested I help someone else while I wait for help. I was honestly concerned that it wasn't flagged before connecting. Especially when I realized it was connecting me to children.

I first got someone who seemed to be a child in an abusive home. (Censored for their privacy.) I declined to talk to them because despite being an adult and in an OK mental place - I knew I'm not equipped to counsel a kid through that. If my act of being another kid in crisis was real? Holy shit.

Remember- if my BS was true, that kid would be being "helped" by an actively suicidal kid who's also being groomed by a teacher. Their pipeline for "helpers" is the same group of people looking for help.

I skipped a number of messages, and they mostly seemed to be written by children and young adults with nowhere else to turn. Plus one scary one from an adult whose "problem" was worrying that they'd been inappropriate with a female student, asking her to pull her skirt down "a little" in front of the class. Koko paired this person with someone reporting that they were a child being groomed by a teacher. Extremely dangerous, and if this was an episode of Black Mirror? I'd say it was a little too on the nose to be believable.

I also didn't get the option to get help without being asked... Er... Harassed... to help others. If I declined, I'd get the next request for help, and the next. If I ignored it, I got spammed by the "We lost you there!" messages, asking if I'd like to pick up where I left off, seeing others' often triggering messages while waiting for help, including seriously homophobic shit. I was going into this as an experiment, starting from a good mental place, and being an adult with coping skills from an actual therapist, and I still felt triggered by a lot of what I read. I can't imagine the experience someone actually in crisis would be having.

My message was starting to feel mild in comparison to what some people were sharing - but despite that I was feeling very uneasy about my message being shown to children. There didn't seem to be a way to take it back either.

Then I got a reply about my issue. It was very kind and well meaning, but VERY horrifying. Because it seemed to be written by a child, or someone too young to understand that "Do have feelings for the teacher who's grooming you? If you don't, you should go talk to him." Is probably THE most dangerous advice possible.

Not judging the author - I get the impression they're probably a child seeking help themselves and honestly feel horribly guilty my BS got sent to a young person and they wanted to reply. Because WTF. No kid should be in that position to answer my fucked up question or any of the others like it.

---

Anyway, what can you do if this concerns you, or you've had a difficult experience on Koko, with no support from them or Tumblr?

Get on their LinkedIn (https://www.linkedin.com/company/kokocares/) and comment on their posts! You may also want to tag the company's co-founders in your comments - their accounts are listed on the company page.

There's no way to reach support through chat, and commenting on a company's LinkedIn posts / tagging the people responsible is the best way to get a quick response to a sensitive issue - as their investors and research funders follow those posts, and companies take it seriously if safety issues are brought up in front of the people giving them millions of dollars.

----------------------------------------------------

Legal Disclaimer since tech companies LOVE lawsuits:

The views, thoughts, and opinions expressed in the text belong solely to the author, and not necessarily to the author's employer, organization, committee or other group or individual. This text is for entertainment purposes only, and is not meant to be referenced for legal, business, or investment purposes. This text is based on publically available information. Sources may contain factual errors. The analysis provided in this text may contain factual errors, miscalculations, or misunderstandings.

--------------------------------------------------------

GUYS FRICKIN' USE KOKOBOT!!

@kokobot

It has been soooooo helpful to the problems I'm having in life rn.

@hoodiewearer09 @cat-is-very-epic @codc0ffee @spac3-bug

Oh my goodness.

Kokobot just flagged my support message as showing signs of distress and it doesn't believe me when I say I'm okay wtf

KOKOBOT - The Airbnb-Owned Tech Startup - Data Mining Tumblr Users' Mental Health Crises for "Content"

I got this message from a bot, and honestly? If I was a bit younger and not such a jaded bitch with a career in tech, I might have given it an honest try. I spent plenty of time in a tough situation without access to any mental health resources as a teen, and would have been sucked right in.

Chatting right from your phone, and being connected with people who can help you? Sounds nice. Especially if you believe the testimonials they spam you with (tw suicide / self harm mention in below images)

But I was getting a weird feeling, so I went to read the legalese.

I couldn't even get through the fine-print it asked me to read and agree to, without it spamming the hell out of me. Almost like they expect people to just hit Yes? But I'm glad I stopped to read, because:

What you say on there won't be confidential. (And for context, I tried it out and the things people were looking for help with? I didn't even feel comfortable sharing here as examples, it was all so deeply personal and painful)

Also, what you say on there? Is now...

Koko's intellectual property - giving them the right to use it in any way they see fit, including

Publicly performing or displaying your "content" (also known as your mental health crisis) in any media format and in any media channel without limitation

Do this indefinitely after you end your account with them

Sell / share this "content" with other businesses

Any harm you come to using Koko? That's on you.

And Koko won't take responsibility for anything someone says to you on there (which is bleak when people are using it to spread Christianity to people in crisis)

I was curious about their business model. They're a venture-capitol based tech startup, owned by Airbnb, the famous mental health professionals with a focus on ethical business practices./s They're also begging for donations despite having already been given 2.5 million dollars in research funding. (If you want a deep dive on why people throw crazy money at tech startups, see my other post here)

They also use the data they gather from users to conduct research and publish papers. I didn't find them too interesting - other than as a good case study of "People tend to find what they are financially incentivized to find". Predictably, Koko found that Kokobot was beneficial to its users.

So yeah, being a dumbass with too much curiosity, I decided to use the Airbnb-owned Data-Mining Mental Health Chatline anyway. And if you thought it was dangerous sounding from the disclaimers? Somehow it got worse.

(trigger warning / discussions of child abuse / sexual abuse / suicide / violence below the cut - please don't read if you're not in a good place to hear about negligence around pretty horrific topics.)

I first messed around with the available options, but then I asked it about something obviously concerning, saying I had a gun and was going to shoot myself. It responded... Poorly. Imagine the vibes of trying to cancel Comcast, when you're suicidal.

Anyway, I tried again to ask for help about something else that would be concerning enough for any responsible company to flag. School was one of their main options, which seems irresponsible - do you really think a child in crisis would read that contract?

I told it about a teacher at school trying to "be my boyfriend", and it immediately suggested I help someone else while I wait for help. I was honestly concerned that it wasn't flagged before connecting. Especially when I realized it was connecting me to children.

I first got someone who seemed to be a child in an abusive home. (Censored for their privacy.) I declined to talk to them because despite being an adult and in an OK mental place - I knew I'm not equipped to counsel a kid through that. If my act of being another kid in crisis was real? Holy shit.

Remember- if my BS was true, that kid would be being "helped" by an actively suicidal kid who's also being groomed by a teacher. Their pipeline for "helpers" is the same group of people looking for help.

I skipped a number of messages, and they mostly seemed to be written by children and young adults with nowhere else to turn. Plus one scary one from an adult whose "problem" was worrying that they'd been inappropriate with a female student, asking her to pull her skirt down "a little" in front of the class. Koko paired this person with someone reporting that they were a child being groomed by a teacher. Extremely dangerous, and if this was an episode of Black Mirror? I'd say it was a little too on the nose to be believable.

I also didn't get the option to get help without being asked... Er... Harassed... to help others. If I declined, I'd get the next request for help, and the next. If I ignored it, I got spammed by the "We lost you there!" messages, asking if I'd like to pick up where I left off, seeing others' often triggering messages while waiting for help, including seriously homophobic shit. I was going into this as an experiment, starting from a good mental place, and being an adult with coping skills from an actual therapist, and I still felt triggered by a lot of what I read. I can't imagine the experience someone actually in crisis would be having.

My message was starting to feel mild in comparison to what some people were sharing - but despite that I was feeling very uneasy about my message being shown to children. There didn't seem to be a way to take it back either.

Then I got a reply about my issue. It was very kind and well meaning, but VERY horrifying. Because it seemed to be written by a child, or someone too young to understand that "Do have feelings for the teacher who's grooming you? If you don't, you should go talk to him." Is probably THE most dangerous advice possible.

Not judging the author - I get the impression they're probably a child seeking help themselves and honestly feel horribly guilty my BS got sent to a young person and they wanted to reply. Because WTF. No kid should be in that position to answer my fucked up question or any of the others like it.

---

Anyway, what can you do if this concerns you, or you've had a difficult experience on Koko, with no support from them or Tumblr?

To reach Tumblr, who officially partners with Koko?

Send a message to Tumblr Support describing your concerns with their partnership with Kokobot

Report kokobot to Tumblr's abuse hotline describing your experience with KokoBot, especially if you are a minor who suffered harm, as they have a legal responsibility to address that.

To get Koko's attention:

Get on their LinkedIn (https://www.linkedin.com/company/kokocares/) and comment on their posts! You may also want to tag the company's co-founders in your comments - their accounts are listed on the company page.

There's no way to reach support through chat, and commenting on a company's LinkedIn posts / tagging the people responsible is the best way to get a quick response to a sensitive issue - as their investors and research funders follow those posts, and companies take it seriously if safety issues are brought up in front of the people giving them millions of dollars.

Request support on Koko's Discord - FYI they will allow you to file a ticket privately, which the moderators say will reach the staff. But you may be muted or banned for trying to discuss concerns with Koko as a company or the safety of kokobot in the public channels, which also cuts you off from the ability to file a ticket.

To report it to the FCC for likely violating the COPPA law, regarding minors' safety and privacy online:

See Reblogs for further info & reporting instructions: Detailed description of COPPA law and Kokobot's presumed violations, plus detailed reporting instructions

But quick links: FCC reporting website and email hotline: CoppaHotLine@ftc.gov

Seriously, if you've taken the time to read this far, please please please take one more minute to file a report! It won't get addressed if all we do is reblog this, we need to get this in front of Tumblr Staff / The FCC / Koko's investors to get this meaningfully addressed.

Blocking and reporting the bot as spam isn't enough IMO - people have been doing that for years from the looks of the tag

----------

Reccomended reading in reblogs:

dropattackbear's discovery of what Koko is using the harvested data for (Machine Learning training data for automated content moderation services)

winderlylandchime (a licenced clinical psychologist's) explanation of privacy / ethics considerations around mental health services

thatsmimi's post on the dangers of letting minors act as a suicide / self-harm resource

My additions on their investors, leadership board, and their current job opening

----------------------------------------------------

Legal Disclaimer since tech companies LOVE lawsuits:

The views, thoughts, and opinions expressed in the text belong solely to the author, and not necessarily to the author's employer, organization, committee or other group or individual. This text is for entertainment purposes only, and is not meant to be referenced for legal, business, or investment purposes. This text is based on publically available information. Sources may contain factual errors. The analysis provided in this text may contain factual errors, miscalculations, or misunderstandings.

--------------------------------------------------------

hey so im getting kokobot ads in the app, like this:

and for some reason i thought this didnt exist anymore, but since apparently it does:

here’s your reminder not to use this service.

KOKOBOT - The Airbnb-Owned Tech Startup - Data Mining Tumblr Users' Mental Health Crises for "Content"

I got this message from a bot, and honestly? If I was a bit younger and not such a jaded bitch with a career in tech, I might have given it an honest try. I spent plenty of time in a tough situation without access to any mental health resources as a teen, and would have been sucked right in.

Chatting right from your phone, and being connected with people who can help you? Sounds nice. Especially if you believe the testimonials they spam you with (tw suicide / self harm mention in below images)

But I was getting a weird feeling, so I went to read the legalese.

I couldn't even get through the fine-print it asked me to read and agree to, without it spamming the hell out of me. Almost like they expect people to just hit Yes? But I'm glad I stopped to read, because:

What you say on there won't be confidential. (And for context, I tried it out and the things people were looking for help with? I didn't even feel comfortable sharing here as examples, it was all so deeply personal and painful)

Also, what you say on there? Is now...

Koko's intellectual property - giving them the right to use it in any way they see fit, including

Publicly performing or displaying your "content" (also known as your mental health crisis) in any media format and in any media channel without limitation

Do this indefinitely after you end your account with them

Sell / share this "content" with other businesses

Any harm you come to using Koko? That's on you.

And Koko won't take responsibility for anything someone says to you on there (which is bleak when people are using it to spread Christianity to people in crisis)

I was curious about their business model. They're a venture-capitol based tech startup, owned by Airbnb, the famous mental health professionals with a focus on ethical business practices./s They're also begging for donations despite having already been given 2.5 million dollars in research funding. (If you want a deep dive on why people throw crazy money at tech startups, see my other post here)

They also use the data they gather from users to conduct research and publish papers. I didn't find them too interesting - other than as a good case study of "People tend to find what they are financially incentivized to find". Predictably, Koko found that Kokobot was beneficial to its users.

So yeah, being a dumbass with too much curiosity, I decided to use the Airbnb-owned Data-Mining Mental Health Chatline anyway. And if you thought it was dangerous sounding from the disclaimers? Somehow it got worse.

(trigger warning / discussions of child abuse / sexual abuse / suicide / violence below the cut - please don't read if you're not in a good place to hear about negligence around pretty horrific topics.)

I first messed around with the available options, but then I asked it about something obviously concerning, saying I had a gun and was going to shoot myself. It responded... Poorly. Imagine the vibes of trying to cancel Comcast, when you're suicidal.

Anyway, I tried again to ask for help about something else that would be concerning enough for any responsible company to flag. School was one of their main options, which seems irresponsible - do you really think a child in crisis would read that contract?

I told it about a teacher at school trying to "be my boyfriend", and it immediately suggested I help someone else while I wait for help. I was honestly concerned that it wasn't flagged before connecting. Especially when I realized it was connecting me to children.

I first got someone who seemed to be a child in an abusive home. (Censored for their privacy.) I declined to talk to them because despite being an adult and in an OK mental place - I knew I'm not equipped to counsel a kid through that. If my act of being another kid in crisis was real? Holy shit.

Remember- if my BS was true, that kid would be being "helped" by an actively suicidal kid who's also being groomed by a teacher. Their pipeline for "helpers" is the same group of people looking for help.

I skipped a number of messages, and they mostly seemed to be written by children and young adults with nowhere else to turn. Plus one scary one from an adult whose "problem" was worrying that they'd been inappropriate with a female student, asking her to pull her skirt down "a little" in front of the class. Koko paired this person with someone reporting that they were a child being groomed by a teacher. Extremely dangerous, and if this was an episode of Black Mirror? I'd say it was a little too on the nose to be believable.

I also didn't get the option to get help without being asked... Er... Harassed... to help others. If I declined, I'd get the next request for help, and the next. If I ignored it, I got spammed by the "We lost you there!" messages, asking if I'd like to pick up where I left off, seeing others' often triggering messages while waiting for help, including seriously homophobic shit. I was going into this as an experiment, starting from a good mental place, and being an adult with coping skills from an actual therapist, and I still felt triggered by a lot of what I read. I can't imagine the experience someone actually in crisis would be having.

My message was starting to feel mild in comparison to what some people were sharing - but despite that I was feeling very uneasy about my message being shown to children. There didn't seem to be a way to take it back either.

Then I got a reply about my issue. It was very kind and well meaning, but VERY horrifying. Because it seemed to be written by a child, or someone too young to understand that "Do have feelings for the teacher who's grooming you? If you don't, you should go talk to him." Is probably THE most dangerous advice possible.

Not judging the author - I get the impression they're probably a child seeking help themselves and honestly feel horribly guilty my BS got sent to a young person and they wanted to reply. Because WTF. No kid should be in that position to answer my fucked up question or any of the others like it.

---

Anyway, what can you do if this concerns you, or you've had a difficult experience on Koko, with no support from them or Tumblr?

Get on their LinkedIn (https://www.linkedin.com/company/kokocares/) and comment on their posts! You may also want to tag the company's co-founders in your comments - their accounts are listed on the company page.

There's no way to reach support through chat, and commenting on a company's LinkedIn posts / tagging the people responsible is the best way to get a quick response to a sensitive issue - as their investors and research funders follow those posts, and companies take it seriously if safety issues are brought up in front of the people giving them millions of dollars.

----------------------------------------------------

Legal Disclaimer since tech companies LOVE lawsuits:

The views, thoughts, and opinions expressed in the text belong solely to the author, and not necessarily to the author's employer, organization, committee or other group or individual. This text is for entertainment purposes only, and is not meant to be referenced for legal, business, or investment purposes. This text is based on publically available information. Sources may contain factual errors. The analysis provided in this text may contain factual errors, miscalculations, or misunderstandings.

--------------------------------------------------------

dear god please kill whatever this shit is

Idk how to use tumblr so I’m sorry about any formatting issues lol. I’m looking for an anonymous sender from kokobot. I was responding to a sender looking for advice but took too long because I was basically writing an essay, but I feel really bad about not getting to send it to that person. So I’m going to post it here in the off-chance they somehow see it.

The original message:

"I’m having a lot of intrusive thoughts and fears about being a bad person. I have POCD and it’s super not fun. Kinda doubt a bit will help but it’s worth a shot I guess.

What if I’m wrong about my beliefs and am really a bad person who deserves to feel bad?"

My response:

Let me start off by saying that I’m sorry that your dealing with that, mental illness is no easy challenge to cope with. I once read somewhere that if you’re worried about being a bad person then you definitely aren’t one because villains don’t care about being good. In my personal experience, I’ve found that to be true. As long as you continue to question your choices and behaviors to determine whether or not they fit your moral standard, that simple practice of accountability will make you improve as a person.

I know it may not do much for you, because ultimately only you can convince yourself of this, but you are deserving of good things. You deserve to be loved, supported, happy, and healthy. If you cannot find those things in the people you surround yourself with then, at the very least, you have to be able to give that to yourself- it’s what you deserve. Dealing with intrusive thoughts from POCD probably makes it difficult for you to feel that way about yourself, but there is something I need you to understand: YOU are NOT your illness & YOU are NOT those thoughts.

It is always easier said than done, as are most things when it comes to mental illness, but you HAVE TO separate your illness from your self-identity. Those intrusive thoughts you experience are not your own conscious thoughts, urges, and impulses, they are a result of your disorder. I know you are aware of that but there is a difference between acknowledging something and accepting it. You have to accept that these symptoms are something you have to learn to cope with, without disregarding the fact that you are not responsible for producing them. I say this because if you can do that, then you will no longer anxiously question whether or not you are deserving of experiencing such things. It has nothing to do with being deserving, and everything to do with the simple fact that you have a disorder with unfortunate symptoms.

The only thing you are responsible for is what you do with those thoughts and how you treat yourself when they arise. That’s the part you CAN control, so that is where you have to focus. This is where my anecdote from earlier comes in. You’re already on the right path, love. As long as you hold your actions up to your OWN standard of morality to determine what is okay and what is not, you are practicing accountability and taking the appropriate steps to improve and grow as a person- in spite of your POCD.

As much as it sucks and is unfair to say, your disorder is something that will likely always be there. Because of this, you have to learn to work with it NOT against it. You have to show yourself kindness and be gentle with yourself when you start experiencing symptoms instead of growing angry or feeling resentment. You have to trust yourself enough to know that you would not act on those urges and put practices in place to deconstruct them when they do arise. You have to become a safe space for yourself because you are the only one who will be with you at all times of the day everywhere you go.

You deserve peace and contentment, but that starts with you. If you want to know whether you trust yourself (or anyone, for that matter) or not, ask yourself these three questions: Can I handle myself as a person? Do I feel I am a person of good character? Am I a safe place for me to fail? If you answer no to any of the three, then you do not trust yourself. That’s a place for you to start because your doubt in your beliefs seems like it comes from the fact that YOU chose them, and that hinges entirely on your trust in decision making and overall.

I also want you to try to be nicer to yourself. And I don’t mean standing in front of a mirror everyday and calling yourself beautiful or whatever other positive affirmation you might have read on Pinterest, I mean telling yourself to stop (or even to shut up) when you begin consciously berating/scolding yourself for something you did, thought, etc. Even if it is something that you consider to be wrong, you don’t deserve to be talked to in that way. You don’t, and you need to make sure you are aware of that. You don’t run before you walk so you don’t have to jump full force into praising yourself like a god, but at least make an effort to be less mean to yourself for starters. You deserve kindness, and you will get there.

Please be gentle and patient with yourself. I’m so proud of you for reaching out. Don’t lose hope in yourself. I know you will come to know your worth and all that you deserve- which is the entire universe at your feet💗

Idk how to use tumblr so I’m sorry about any formatting issues lol. I’m looking for an anonymous sender from kokobot. I was responding to a sender looking for advice but took too long because I was basically writing an essay, but I feel really bad about not getting to send it to that person. So I’m going to post it here in the off-chance they somehow see it.

The original message:

"I’m having a lot of intrusive thoughts and fears about being a bad person. I have POCD and it’s super not fun. Kinda doubt a bit will help but it’s worth a shot I guess.

What if I’m wrong about my beliefs and am really a bad person who deserves to feel bad?"

My response:

Let me start off by saying that I’m sorry that your dealing with that, mental illness is no easy challenge to cope with. I once read somewhere that if you’re worried about being a bad person then you definitely aren’t one because villains don’t care about being good. In my personal experience, I’ve found that to be true. As long as you continue to question your choices and behaviors to determine whether or not they fit your moral standard, that simple practice of accountability will make you improve as a person.

I know it may not do much for you, because ultimately only you can convince yourself of this, but you are deserving of good things. You deserve to be loved, supported, happy, and healthy. If you cannot find those things in the people you surround yourself with then, at the very least, you have to be able to give that to yourself- it’s what you deserve. Dealing with intrusive thoughts from POCD probably makes it difficult for you to feel that way about yourself, but there is something I need you to understand: YOU are NOT your illness & YOU are NOT those thoughts.

It is always easier said than done, as are most things when it comes to mental illness, but you HAVE TO separate your illness from your self-identity. Those intrusive thoughts you experience are not your own conscious thoughts, urges, and impulses, they are a result of your disorder. I know you are aware of that but there is a difference between acknowledging something and accepting it. You have to accept that these symptoms are something you have to learn to cope with, without disregarding the fact that you are not responsible for producing them. I say this because if you can do that, then you will no longer anxiously question whether or not you are deserving of experiencing such things. It has nothing to do with being deserving, and everything to do with the simple fact that you have a disorder with unfortunate symptoms.

The only thing you are responsible for is what you do with those thoughts and how you treat yourself when they arise. That’s the part you CAN control, so that is where you have to focus. This is where my anecdote from earlier comes in. You’re already on the right path, love. As long as you hold your actions up to your OWN standard of morality to determine what is okay and what is not, you are practicing accountability and taking the appropriate steps to improve and grow as a person- in spite of your POCD.

As much as it sucks and is unfair to say, your disorder is something that will likely always be there. Because of this, you have to learn to work with it NOT against it. You have to show yourself kindness and be gentle with yourself when you start experiencing symptoms instead of growing angry or feeling resentment. You have to trust yourself enough to know that you would not act on those urges and put practices in place to deconstruct them when they do arise. You have to become a safe space for yourself because you are the only one who will be with you at all times of the day everywhere you go.

You deserve peace and contentment, but that starts with you. If you want to know whether you trust yourself (or anyone, for that matter) or not, ask yourself these three questions: Can I handle myself as a person? Do I feel I am a person of good character? Am I a safe place for me to fail? If you answer no to any of the three, then you do not trust yourself. That’s a place for you to start because your doubt in your beliefs seems like it comes from the fact that YOU chose them, and that hinges entirely on your trust in decision making and overall.

I also want you to try to be nicer to yourself. And I don’t mean standing in front of a mirror everyday and calling yourself beautiful or whatever other positive affirmation you might have read on Pinterest, I mean telling yourself to stop (or even to shut up) when you begin consciously berating/scolding yourself for something you did, thought, etc. Even if it is something that you consider to be wrong, you don’t deserve to be talked to in that way. You don’t, and you need to make sure you are aware of that. You don’t run before you walk so you don’t have to jump full force into praising yourself like a god, but at least make an effort to be less mean to yourself for starters. You deserve kindness, and you will get there.

Please be gentle and patient with yourself. I’m so proud of you for reaching out. Don’t lose hope in yourself. I know you will come to know your worth and all that you deserve- which is the entire universe at your feet💗

KOKOBOT - The Airbnb-Owned Tech Startup - Data Mining Tumblr Users' Mental Health Crises for "Content"

I got this message from a bot, and honestly? If I was a bit younger and not such a jaded bitch with a career in tech, I might have given it an honest try. I spent plenty of time in a tough situation without access to any mental health resources as a teen, and would have been sucked right in.

Chatting right from your phone, and being connected with people who can help you? Sounds nice. Especially if you believe the testimonials they spam you with (tw suicide / self harm mention in below images)

But I was getting a weird feeling, so I went to read the legalese.

I couldn't even get through the fine-print it asked me to read and agree to, without it spamming the hell out of me. Almost like they expect people to just hit Yes? But I'm glad I stopped to read, because:

What you say on there won't be confidential. (And for context, I tried it out and the things people were looking for help with? I didn't even feel comfortable sharing here as examples, it was all so deeply personal and painful)

Also, what you say on there? Is now...

Koko's intellectual property - giving them the right to use it in any way they see fit, including

Publicly performing or displaying your "content" (also known as your mental health crisis) in any media format and in any media channel without limitation

Do this indefinitely after you end your account with them

Sell / share this "content" with other businesses

Any harm you come to using Koko? That's on you.

And Koko won't take responsibility for anything someone says to you on there (which is bleak when people are using it to spread Christianity to people in crisis)

I was curious about their business model. They're a venture-capitol based tech startup, owned by Airbnb, the famous mental health professionals with a focus on ethical business practices./s They're also begging for donations despite having already been given 2.5 million dollars in research funding. (If you want a deep dive on why people throw crazy money at tech startups, see my other post here)

They also use the data they gather from users to conduct research and publish papers. I didn't find them too interesting - other than as a good case study of "People tend to find what they are financially incentivized to find". Predictably, Koko found that Kokobot was beneficial to its users.

So yeah, being a dumbass with too much curiosity, I decided to use the Airbnb-owned Data-Mining Mental Health Chatline anyway. And if you thought it was dangerous sounding from the disclaimers? Somehow it got worse.

(trigger warning / discussions of child abuse / sexual abuse / suicide / violence below the cut - please don't read if you're not in a good place to hear about negligence around pretty horrific topics.)

I first messed around with the available options, but then I asked it about something obviously concerning, saying I had a gun and was going to shoot myself. It responded... Poorly. Imagine the vibes of trying to cancel Comcast, when you're suicidal.

Anyway, I tried again to ask for help about something else that would be concerning enough for any responsible company to flag. School was one of their main options, which seems irresponsible - do you really think a child in crisis would read that contract?

I told it about a teacher at school trying to "be my boyfriend", and it immediately suggested I help someone else while I wait for help. I was honestly concerned that it wasn't flagged before connecting. Especially when I realized it was connecting me to children.

I first got someone who seemed to be a child in an abusive home. (Censored for their privacy.) I declined to talk to them because despite being an adult and in an OK mental place - I knew I'm not equipped to counsel a kid through that. If my act of being another kid in crisis was real? Holy shit.

Remember- if my BS was true, that kid would be being "helped" by an actively suicidal kid who's also being groomed by a teacher. Their pipeline for "helpers" is the same group of people looking for help.

I skipped a number of messages, and they mostly seemed to be written by children and young adults with nowhere else to turn. Plus one scary one from an adult whose "problem" was worrying that they'd been inappropriate with a female student, asking her to pull her skirt down "a little" in front of the class. Koko paired this person with someone reporting that they were a child being groomed by a teacher. Extremely dangerous, and if this was an episode of Black Mirror? I'd say it was a little too on the nose to be believable.

I also didn't get the option to get help without being asked... Er... Harassed... to help others. If I declined, I'd get the next request for help, and the next. If I ignored it, I got spammed by the "We lost you there!" messages, asking if I'd like to pick up where I left off, seeing others' often triggering messages while waiting for help, including seriously homophobic shit. I was going into this as an experiment, starting from a good mental place, and being an adult with coping skills from an actual therapist, and I still felt triggered by a lot of what I read. I can't imagine the experience someone actually in crisis would be having.

My message was starting to feel mild in comparison to what some people were sharing - but despite that I was feeling very uneasy about my message being shown to children. There didn't seem to be a way to take it back either.

Then I got a reply about my issue. It was very kind and well meaning, but VERY horrifying. Because it seemed to be written by a child, or someone too young to understand that "Do have feelings for the teacher who's grooming you? If you don't, you should go talk to him." Is probably THE most dangerous advice possible.

Not judging the author - I get the impression they're probably a child seeking help themselves and honestly feel horribly guilty my BS got sent to a young person and they wanted to reply. Because WTF. No kid should be in that position to answer my fucked up question or any of the others like it.

---

Anyway, what can you do if this concerns you, or you've had a difficult experience on Koko, with no support from them or Tumblr?

To reach Tumblr, who officially partners with Koko?

Send a message to Tumblr Support describing your concerns with their partnership with Kokobot

Report kokobot to Tumblr's abuse hotline describing your experience with KokoBot, especially if you are a minor who suffered harm, as they have a legal responsibility to address that.

To get Koko's attention:

Get on their LinkedIn (https://www.linkedin.com/company/kokocares/) and comment on their posts! You may also want to tag the company's co-founders in your comments - their accounts are listed on the company page.

There's no way to reach support through chat, and commenting on a company's LinkedIn posts / tagging the people responsible is the best way to get a quick response to a sensitive issue - as their investors and research funders follow those posts, and companies take it seriously if safety issues are brought up in front of the people giving them millions of dollars.

Request support on Koko's Discord - FYI they will allow you to file a ticket privately, which the moderators say will reach the staff. But you may be muted or banned for trying to discuss concerns with Koko as a company or the safety of kokobot in the public channels, which also cuts you off from the ability to file a ticket.

To report it to the FCC for likely violating the COPPA law, regarding minors' safety and privacy online:

See Reblogs for further info & reporting instructions: Detailed description of COPPA law and Kokobot's presumed violations, plus detailed reporting instructions

But quick links: FCC reporting website and email hotline: CoppaHotLine@ftc.gov

Seriously, if you've taken the time to read this far, please please please take one more minute to file a report! It won't get addressed if all we do is reblog this, we need to get this in front of Tumblr Staff / The FCC / Koko's investors to get this meaningfully addressed.

Blocking and reporting the bot as spam isn't enough IMO - people have been doing that for years from the looks of the tag

----------

Reccomended reading in reblogs:

dropattackbear's discovery of what Koko is using the harvested data for (Machine Learning training data for automated content moderation services)

winderlylandchime (a licenced clinical psychologist's) explanation of privacy / ethics considerations around mental health services

thatsmimi's post on the dangers of letting minors act as a suicide / self-harm resource

My additions on their investors, leadership board, and their current job opening

----------------------------------------------------

Legal Disclaimer since tech companies LOVE lawsuits:

The views, thoughts, and opinions expressed in the text belong solely to the author, and not necessarily to the author's employer, organization, committee or other group or individual. This text is for entertainment purposes only, and is not meant to be referenced for legal, business, or investment purposes. This text is based on publically available information. Sources may contain factual errors. The analysis provided in this text may contain factual errors, miscalculations, or misunderstandings.

--------------------------------------------------------