Members of the Laboratory for Research of Individual Differences have been committed to the principles of Open Science for many years. Our goal is to promote Open Science as scientific value, the integrity of research, and participate in improving the replicability of psychological findings.

Our partners in this endeavor are the Center for Open Science –COS that maintains an open-source software project which facilitates open collaboration in scientific research, Open Science Framework, Psychological Science Accelerator – PSA – a network of psychological labs which are committed to the accumulation of reliable and generalizable findings, The Leibniz Institute for Psychology Information and Documentation – a public Institute for Psychology which offers support to scientists throughout the entire research process, as well as the Center for Science Promotion (Centar za promociju nauke) through the project Responsible Research and Innovation (RRI).

Members of the Laboratory for Research of Individual Differences respect and apply the recommendations from the Open Science Platform. Apart from actively supporting and applying good scientific practices, such as preregistering studies, open data, open materials, open code – which is also in accordance with the requirements of the Serbian Ministry of Education, Science and Technological Development and European Union institutions, some of the members of the Laboratory for Research in Individual Differences take part in the evaluation of research practices and giving recommendations for Open science as well as informing the academic community about the needs and principles of its implementation.

In the spirit of opening and sharing resources, LIRA members have initiated the project REPOPSI – Repository of psychological instruments in Serbian, where more than 200 original and translated/adapted psychological measures, scales, tests and other instruments are currently deposited.

The research line dedicated to Open Science is grouped across several larger themes.

  1. Replicability of empirical findings in psychological research.
    • Reproducibility Project: Psychology – Estimating the Reproducibility of Psychological Science (Open Science Collaboration, 2015),
    • Replications of Important Results in Social Psychology (Žeželj & Jokić, 2014)
    •  Manylabs 2 project: Investigating Variation in Replicability Across Sample and Setting (Klein et al., 2018), 
    • Many Labs 5: Testing pre-data collection peer review as an intervention to increase replicability (Baranski et al., 2020; Ebersole et al., IPA; Lazarevic et al., IPA) 
    • CREP – Collaborative Replications and Education Project (Wagge et al., 2019)
    • Forecasting survey: Can you predict a study’s results just from looking at the materials? (Landy et al., 2020),
    • Psychological Science Accelerator – PSA 006: On the universality of moral thinking: Cross-cultural variation in the influence of personal force and intention in moral dilemma judgments (Bago et al., IPA). 
  2. Investigating the universality of psychological phenomena in cross-cultural studies:
  3. Research and improvement of publication standards and policies in journals: The Effect of Badges on Availability of Data and Materials project (Kidwell, Lazarević, et al, 2016). 
  4. Promoting and encouraging Open Science principles:
    • PSSOH conference – Members of the Laboratory of Open Science annually participate in the PSSOH conference  (Application of free software and open hardware) organized by the Faculty of Electrical Engineering in Belgrade (Lazarevic & Žeželj, 2018; Purić, Žeželj, Lazarević, Knežević, 2019)
    • Danube Conference for Higher Education, Ulm, Nemačka, 2017 (plenary presentations: Open science challenges – increasing transparency and reproducibility of psychological science – Ljiljana Lazarevic; Good scientific practices – Iris Žeželj).
    •  Responsible Research and Innovation (RRI) project by the Center for Science Promotion (invited panelist at the RRI Tools conference 2016 – Iris Žeželj; organizer of the RRI training Open science: public, reproducible and cumulative – Iris Žeželj)
    • Glossary of open scholarship terms – As part of the FORRT (Framework for Open and Reproducible Research Training) collaboration, Aleksandra Lazić contributed to a glossary of open scholarship terms (Parsons, S., Azevedo, F., Elsherif, M. M., … Lazić, A., …, & Aczel, B., 2022)


Our publications within this research line


Wagge, J. R., Hurst, M. A., Brandt, M. J., Lazarevic, Lj. B. Legate, N., & Grahe, J. E. (2023). Teaching Research in Principle and in Practice: What Do Psychology Instructors Think of Research Projects in Their Courses? Psychology Learning and Teaching. https://psyarxiv.com/t79dm/

Psychological Science Accelerator Self-Determination Theory Collaboration (including Lazarević, Lj. B.) (2022). A global experiment on motivating social distancing during the COVID-19 pandemic. Proceedings of the National Academy of Sciences. DOI: 10.31234/osf.io/n3dyf

Bago, B., Aczel, B., Kekecs, Z., Protzko, J., Kovacs, M., Nagy, T., …, Jokic, B., …, Puric, D., … Zezelj, I.,.., Lazarevic, Lj. B., ….Chartier, C. R. (2022). Situational factors shape moral judgments in the trolley dilemma in Eastern, Southern, and Western countries in a culturally diverse sample. Nature Human Behaviour.

Parsons, S., Azevedo, F., Elsherif, M. M., … Lazić, A., …, & Aczel, B. (2022). A community-sourced glossary of open scholarship terms. Nature Human Behaviour. https://doi.org/10.1038/s41562-021-01269-4

Wang, K, Goldenberg, A., Dorison, C.A., Miller, J.K., Uusberg, A., Lerner, J.S., Gross, J.J. & Psychological Science Accelerator (incl. Lazarević, Lj.B., & Bulut, T.) (2021). A multi-country test of brief reappraisal interventions on emotions during the COVID-19 pandemic. Nature Human Behavior, 5(8), 1089-1110. https://doi.org/10.1038/s41562-021-01173-x

Tierney, W., Hardy, J. H., III., Ebersole, C., … , Culture and Work Morality Forecasting Collaboration (incl. Lazić, A., & Purić, D.), & Uhlmann, E. L. (2021). A creative destruction approach to replication: Implicit work and sex morality across cultures. Journal of Experimental Social Psychology, 93, 104060. https://doi.org/10.1016/j.jesp.2020.104060

Ebersole, C. R., Mathur, M. B., Baranski, E., Bart-Plange, D., Buttrick, N. R., Chartier, C. R., Corker, K. S., Corley, M., Hartshorne, J. K., IJzerman, H., Lazarevic, Lj. B., Rabagliati, H., Ropovik, I., Aczel, B., Aeschbach, L. F., Andrighetto, L., Arnal, J. D., Arrow, H., Babincak, P., Bakos, B. E., Baník, G., Baskin, E., Belopavlović, R., Bernstein, M. H., Białek, M., Bloxsom, N. G., Bodroža, B., Bonfiglio, D. B. V., Boucher, L., Brühlmann, F., Brumbaugh, C., Casini, E., Chen, Y., Chiorri, C., Chopik, W. J., Christ, O., Ciunci, A. M., Claypool, H. M., Coary, S., Čolić, M. V., Collins, W. M., Curran, P. G., Day, C. R., Dering, B., Dreber, A., Edlund, J. E., Falcão, F., Fedor, A., Feinberg, L., Ferguson, I. R., Ford, M., Frank, M. C., Fryberger, E., Garinther, A., Gawryluk, K., Gerken, K., Giacomantonio, M., Giessner, S. R., Grahe, J. E., Guadagno, R. E., Hałasa, E., Hancock, P. J. B., Hilliard, R. A., Hüffmeier, J., Hughes, S., Idzikowska, K., Inzlicht, M., Jern, A., Jiménez-Leal, W., Johannesson, M., Joy-Gaba, J. A., Kauff, M., Kellier, D. J., Kessinger, G., Kidwell, M. C., Kimbrough, A. M., King, J. P. J., Kolb, V. S., Kołodziej, S., Kovacs, M., Krasuska, K., Kraus, S., Krueger, L. E., Kuchno, K., Lage, C. A., Langford, E. V., Levitan, C. A., de Lima, T. J. S., Lin, H., Lins, S., Loy, J. E., Manfredi, D., Markiewicz, Ł., Menon, M., Mercier, B., Metzger, M., Meyet, V., Millen, A. E., Miller, J. K., Moore, D. A., Muda, R., Nave, G., Nichols, A. L., Novak, S. A., Nunnally, C., Orlić, A., Palinkas, A., Panno, A., Parks, K. P., Pedović, I., Pękala, E., Penner, M. R., Pessers, S., Petrović, B., Pfeiffer, T., Pieńkosz, D., Preti, E., Purić, D., Ramos, T., Ravid, J., Razza, T. S., Rentzsch, K., Richetin, J., Rife, S. C., Rosa, A. D., Rudy, K. H., Salamon, J., Saunders, B., Sawicki, P., Schmidt, K., Schuepfer, K., Schultze, T., Schulz-Hardt, S., Schütz, A., Shabazian, A., Shubella, R. L., Siegel, A., Silva, R., Sioma, B., Skorb, L., de Souza, L. E. C., Steegen, S., Stein, LAR, Sternglanz, R. W., Stojilović, D., Storage, D., Sullivan, G. B., Szaszi, B., Szecsi, P., Szoke, O., Szuts, A., Thomae, M., Tidwell, N. D., Tocco, C., Torka, A., Tuerlinckx, F., Vanpaemel, W., Vaughn, L. A., Vianello, M., Viganola, D., Vlachou, M., Walker, R. J., Weissgerber, S. C., Wichman, A. L., Wiggins, B. J., Wolf, D., Wood, M. J., Zealley, D., Žeželj, I., Zrubka, M., & Nosek, B. A. (2020). Many Labs 5: Testing pre-data collection peer review as an intervention to increase replicability. Advances in Methods and Practices in Psychological Science.

Baranski, E., Baskin, E., Coary, S., Ebersole, C. R., Krueger, L. E., Lazarevic, Lj. B., Miller, J. K., Orlic, A., Penner, M., Puric, D., Rife, S. C., Vaughn, L. A., Wichman, A., & Zezelj, I. (2020). Many Labs 5: Registered Replication Report of Shnabel & Nadler, (2008), Study 4. Advances in Methods and Practices in Psychological Science.

Lazarevic, Lj. B., Puric, D., Zezelj, I., Belopavlovic, R., Bodroza, B., Colic, M. V., Ebersole, C. R., Ford, M., Orlic, A., Pedovic, I., Petrovic, B., Shabazian, A., Stojilovic, D. (2020). Many Labs 5: Registered Replication of LoBue & DeLoache (2008). Advances in Methods and Practices in Psychological Science. doi: doi.org/10.1177/2515245920953350 PDF

Landy, J. F., Jia, M., Ding, I. L., Viganola, D. Tierney, W.,…, Lazarević, Lj. B.,…, Purić, D., …., Žeželj, I.,…, Uhlmann, E. L. (2020). Crowdsourcing hypothesis tests: Making transparent how design choices shape research results. Psychological Bulletin. Advance online publication. http://dx.doi.org/10.1037/bul0000220 [pdf]

Hu, C-P., Yin, J., Lindenberg, S., Dalğar, I., Weissgerber, S. S., Vergara, R. C., Cairo, A. H., Čolić, M. V., Dursun, P., Frankowska, N., Hadi, R.,  Hall, C. J., Hong, Y., Joy-Gaba, J. Lazarević, D., Lazarević, Lj. B., Parzuchowski, M., Ratner, K. G., Rothman, D., Sim, S., Simão, C., Song, M., Stojilović, D., Blomster, J. K., Brito, R., Hennecke, M., Jaume-Guazzini, F., Schubert, T. W., Schütz, A., Seibt, B., Zickfeld, J. H., & IJzerman, H. (2019). Data from a cross-national project testing principles from social thermoregulation theory. Scientific Data, 6:32. https://doi.org/10.1038/s41597-019-0029-2 [pdf]

Wagge, J. R.,  Brandt, M. J., Lazarević, Lj. B., Legate, N., Christopherson, C, Wiggins, B., & Grahe, J. E. (2019). Publishing Research with Undergraduate Students via Replication Work: The Collaborative Replications and Education Project. Frontiers in Psychology, 10:247. https://doi.org/10.3389/fpsyg.2019.00247 [html]

Wagge, J. R., Brandt, M. J.,  Lazarevic, Lj. B., Legate, N., Christopherson, C.,  Wiggins, B. & Grahe, J. E. (2019). Publishing Research with Undergraduate Students via Replication Work: The Collaborative Replications and Education Project. In Giuliano, T. A., Skorinko, J. L. M., Fallon, M., (Eds.) Engaging Undergraduates in Publishable Research: Best Practices. Lausanne: Frontiers Media. doi: 10.3389/978-2-88963-144-5 E-book

Ijzerman, H., Lindenberg, S. M., Dalğar, I., Weissgerber, S., Vergara, R. C., Cairo, A. H., Čolić, M. V., Dursun, P., Frankowska, N., Hadi, R., Hall, C. J., Hong, Y., Hu, C. P., Joy-Gaba, J., Lazarević, D., Lazarević, Lj. B., Parzuchowski, M., Ratner, K. G., Rothman, D., Sim, S., Simão, C., Song, M., Stojilović, D., Blomster, J. K, Brito, R., Hennecke, M., Jaume-Guazzini, F., Schubert, T. W., Schütz, A., Seibt, B., & Zickfeld, J. H. (2018). The Human Penguin Project: Climate, Social Integration, and Core Body Temperature. Collabra: Psychology, 4(1), 37. doi: http://doi.org/10.1525/collabra.165  [html]

Zickfeld, J., Schubert, T., Seibt, B., Blomster, J., Arriaga, P., Basabe, N., Blaut, A., Caballero, A., Carrera, P., Dalgar, I., Ding, Y., Dumont, K., Gaulhofer, V., Gracanin, A., Gyenis, R., Hu, C., Kardum, I., Lazarević, Lj. B., Mathew, L., Menster, S., Nussinson, R., Onuki, M., Páez, D., Pásztor, A., Peng, K., Petrović, B., Pizarro, J. J.,  Schönefeld, V., Smieia, M., Tokaji, A., Vingerhoets, A., Vuoskoski, J., Vorster, A., Zhu, L., & Fiske, A. (2018). Kama Muta: Conceptualizing and Measuring the Experience of Being Moved Across 19 Nations and 15 Languages. Emotion. Advance online publication. doi: 10.1037/emo0000450  [pdf]

Buttrick, N. R., Choi, H., Wilson, T. D., Oishi, S., Boker, S. M., Gilbert, D. T., Alper, S., Aveyard, M.,  Cheong, W., Čolić, M. V., Dalgar, I., Doğulu, C., Karabati, S., Kim, E., Knežević, G., Komiya, A., Ordóñez Laclé, C., Ambrosio Lage, C.,  Lazarević, Lj., B., Lazarević, D., Lins, S., Blanco Molina, M., Neto, F., Orlić, A., Petrović, B., Arroyo Sibaja, M., Torres Fernández, D., Vanpaemel, W., Voorspoels, W., Wilks, D. C. (2018). Cross-Cultural Consistency and Relativity in the Enjoyment of Thinking versus Doing. Journal of Personality and Social Psychology. http://dx.doi.org/10.1037/pspp0000198[pdf]

Klein, R. A., Vianello, M., Hasselman, F., Adams, B. G., Adams, R. B., Alper, S., Aveyard, M., Axt, J. R., Bahník, Š., Batra, R., Berkics, M., Bernstein, M. J., Berry, D., Bialobrzeska, O., Binan, E., Bocian, K., Brandt, M. J., Busching, R., Rédei, A. C., Cai, H., Cambier, F., Cantarero, K., Carmichael, C. L., Ceric, F., Cicero, D. C., Chandler, J., Chatard, A., Chen, E. E., Chang, J-H., Cheong, W., Coen, S., Coleman, J. A., Collisson, B., Conway, M. G., Corker, K. S., Curran, P. G., Cushman, F., Dagon, Z. K., Dalgar, I., Dalla Rosa, A., Davis, W. E., de Bruijn, M., De Schutter, L., Devos, T., Doğulu, C., Dozo, N., Dukes, K. N., Dunham, Y., Durrheim, K., Ebersole, C. R., Edlund, J. E., English, A. S., Eller, A., Finck, C., Frankowska, N., Freyre, M-Á, Friedman, M., Galliani, E. M., Gandi, J. C., Ghoshal, T., Giessner, S. R., Gill, T., Gnambs, T., Gómez, Á., González, R., Graham, J., Grahe, J. E., Grahek, I., Green, E. G. T., Hai, K., Haigh, M., Haines, E. L., Hall, M. P., Heffernan, M. E., Hicks, J. A., Houdek, P., Huntsinger, J. R., Huynh, H. P., IJzerman, H., Inbar, Y., Innes-Ker, Å. H., Jiménez-Leal, W., John, M-S., Joy-Gaba, J. A., Kende, A., Kamiloğlu, R. G., Kappes, H. B., Karabati, S., Karick, H., Keller, V. N., Kervyn, N., Knežević, G., Kovacs, C., Krueger, L. E., Kurapov, G., Kurtz, J., Lakens, D., Lazarević, Lj. B., Levitan, C. A., Lins, S., Lipsey, S., Losee, J., Maassen, E., Maitner, A. T., Malingumu, W., Mallett, R. K., Marotta, S. A., Međedović, J., Mena Pacheco, F., Milfont, T. L., Morris, W. L., Murphy, S., Myachykov, A., Neave, N., Neijenhuijs, K., Nelson, A. J., Neto, F., Nichols, A. L., Ocampo, A., O’Donnell, S. L., Ong, E., Osowiecka, M., Orosz, G., Packard, G., Pérez-Sánchez, R., Petrović, B., Pilati, R., Pinter, B., Podesta, L., Pogge, G., Pollmann, M. M. H., Rutchick, A. M., Saeri, A., Saavedra, P., Salomon, E., Schmidt, K., Schönbrodt, F. D., Sekerdej, M. B., Sirlopú, D., Skorinko, J. L. M., Smith, M. A., Smith-Castro, V., Smolders, K., Sobkow, A., Sowden, W., Srivastava, M., Sundfelt, O. K., Spachtholz, P., Steiner, T. G., Stouten, J., Street, C. N. H., Szeto, S., Szumowska, E., Tang, A., Tanzer, N., Tear, M., Thomae, M., Traczyk, J., Torres, D., Theriault, J., Tybur, J. M., Ujhelyi, A., van Aert, R. C. M., van Assen, M. A. L. M., van Lange, P. A. M., van der Hulst, M., van ‘t Veer, A. E., Vásquez Echeverría, A., Vaughn, L. A., Vázquez, A., Vega, L. D., Verniers, C., Verschoor, M., Voermans, I., Vranka, M. A., de Vries, M., Welch, C., Wichman, A. L., Williams, L. A., Wood, M., Woodzicka, J. A., Wronska, M. K., Young, L., Zelenski, J. M., Zhijia, Z., & Nosek, B. A. (2018). Many labs 2: Investigating variation in replicability across sample and setting.  Advances in Methods and Practices in Psychological Science, 1(4), 443-490. https://doi.org/10.1177/2515245918810225 [pdf]

IJzerman, H., Čolić, M., Hennecke, M., Hong, Y., Hu, C., Joy-Gaba, J., Lazarević, D., Lazarević, Lj. B., Parzuchowski, M., Ratner, K., Schubert, T., Schütz, A., Stojilović, D., Weissgerber, S., Zickfeld. J., & Lindenberg, S.,  (2017). Does Distance from the Equator Predict Self-Control? Lessons from the Human Penguin Project. Behavioral and Brain Sciences, 40, e86
https://doi.org/10.1017/S0140525X16001035
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2821804

Kidwell, M. C., Lazarevic, Lj. B., Baranski, E., Hardwicke, T. E., Piechowski, S., Falkenberg, L-S., Kennett, C., Slowik, A., Sonnleitner, C., Hess-Holden, C., Errington, T. M., Fiedler, S., & Nosek, B. A. (2016). Badges to acknowledge open practices: A simple, low-cost, effective method for increasing transparency. PLoS Biology, 14(5), 1-15.  doi:http://10.1371/journal.pbio.1002456 [pdf]

Open Science Collaboration (incl. Lazarević, Lj. B. & Knežević, G.). (2015). Estimating the reproducibility of psychological science. Science, 349(6251), DOI: 10.1126/science.aac4716 [pdf]

De Bolle, M. …., Bratko, D., … Knežević, G., Purić, D. …  & Terracciano, A. (2015). The Emergence of Sex Differences in Personality Traits in Early Adolescence: A Cross-Sectional, Cross-Cultural Study. Journal of Personality and Social Psychology, 108(1), 171-185. doi:http://dx.doi.org/10.1037/a0038497 [html]

Gong, H., Medin, D. L., Eyal, T., Liberman, N., Trope, Y., Žeželj, I. L., & Jokić, B. R. (2014). Commentaries and rejoinder on Žeželj and Jokić (2014). Social Psychology. https://doi.org/10.1027/1864-9335/a000206

McCrae, R. R., …, Bratko, D., …,  Knežević, G., Purić, D., … & Terracciano, A. (2013). The inaccuracy of national character stereotypes. Journal of Research in Personality, 47, 831–842. doi:10.1016/j.jrp.2013.08.006. [pdf]

Chan W, …, Bratko, D., …, Knežević G,…Terracciano A. (2012). Stereotypes of Age Differences in Personality Traits: Universal and Accurate? Journal of Personality and Social Psychology, 103(6), 1050-66. doi:10.1037/a0029712. [html]

Terraciano, A., …, Bratko, D., …, Knežević, G.,…McCrae, R.R. (2005). National character does not reflect mean personality trait levels in 49 cultures. Science, 310 (5745), 96-100. doi:10.1126/science.1117199; [pdf]

Džamonja Ignjatović, T. & Knežević, G. (2005). Psihobiološki model temperamenta i karaktera – validacija i kros-kulturna komparacija (Psychobiological model of temperament and character – validation and cross-cultural comparison). Psihologija, 38, 295-309. [pdf]