The recent backlash against the #MeToo movement suggests men should fear false accusations or reactive company investigations because of the pressure from social media or news organizations, yet little evidence exists to prove a push against sexual harassment in the workforce hurts men, experts and federal regulators said Wednesday.

Any unintended consequences of the movement targeting harassment may rather be at the expense of women in the workplace, who may be left out of advancement opportunities, such as socializing with bosses or mentorships, according to the panel at the U.S. Equal Employment Opportunity Commission’s public meeting.

“With social causes there is always the unintended consequence of a backlash,” Morgan, Lewis & Bockius partner David Bowman told the commission. “That problem is in the minority not the majority.”

Related: The #MeToo Backlash Is Building

Federal regulators want to make sure the #MeToo movement is more than a moment that gives women temporary power and help tackle the structures that allowed sexual harassment to persist for years in the workplace. The EEOC, which saw sexual harassment charges spike last fiscal year, asked attorneys, academics and human resource trainers to delve into what is working and what still needs attention to prevent not just sexual harassment, but also against other protected classes.

EEOC Chairwoman Victoria Lipnic said that the belief that #MeToo has gone “too far” suggests there are views that believe there is a rush to judgment, unproven accusations and a bandwagon effect. She asked the panel whether this idea could negatively affect company attempts to change the culture.

“It’s important to remember when we look back at the #MeToo movement that is now a year old that when we first started this was not one of false complaints. The issue was about complaints that did not surface,” Bowman said. “That is the core.”

‘Men Are Worried’

Bowman said there has not been a wave of false accusations causing people to lose their jobs or haphazard investigations. 

“Men are worried [the companies] are pulling the trigger too quickly,” he said. “Exclusion from work activities, whether intentional or not, can stunt diverse employees’ careers. They must focus on the business imperative of corporate values not just fit within the legal or regulatory framework.”

Commissioner Chai Feldblum said the commission, which issued harassment guidelines in 2016, is attempting to “nip [it] in the bud before it arose.”

The final fiscal year 2018 data showed a 13.6 percent increase in sexual harassment charges and a 50 percent increase in lawsuits filed alleging sexual harassment. The push to combat harassment started with a task force that studied harassment in the workplace in 2016. The #MeToo movement sparked by allegations by The New York Times and The New Yorker against Harvey Weinstein helped draw attention to the issues raised in the report, the commissioners said. Now, they want to leverage this attention to create institutionalized change.

Related story: #MeToo at the Bookstore: Barnes & Noble Claims It Fired CEO for Sexual Misconduct

“We stand at a watershed moment with regard to harassment,” Feldblum said. “We can see it. We can hear it. We can feel it. The question is whether we can—and will—leverage this moment to significant and sustainable change. I believe we can.”

Companies responded to the #MeToo movement in force, with many investing in additional training and internal investigations into their policies. The solutions are far from set in stone,  however. There are also unintended consequences. According to a survey by Working Mother and the ABA Journal released this year, most men (56 percent) are nervous about one-on-one interactions with women at work and the charges of impropriety that might result.

EEOC Commissioner Charlotte Burrows also said that it’s important not to focus training and harassment prevention only on women. The reaction should encompass all protected classes, race, national origin and religion, as well.

“This sparked an overdue conversation, but the challenge is to find concrete solutions so that workplaces reflect our values of equality, justice and respect for human dignity,” Burrows said. “We need to find ways to change the culture.”

The witnesses, which included union leaders, academics and attorneys, at the meeting suggested training approaches and accountability measures to address harassment. They pointed to the importance of board input, transparency and accountability, online and other interactive training and movements driven from within the workforce. The commissioners said they want to create guidelines that will fit many types of industries.

Additional training on its own does little to move the needle for workplace culture improvements, the 2016 agency task force concluded. The report found such training “cannot stand alone, but rather must be part of a holistic effort.”

Bowman said organizations must use a multifaceted campaign that focuses on leaders setting the right tone, conducting a workplace culture assessment, and implementing different training formats that inspire employees to create a more positive setting that works for everyone.

“It is important that organizations create a healthy top-down culture,” Bowman said, “where managers and leaders actively support the prospect of creating a healthier work environment.”